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ABSTRACT 

An  adaptive  algorithm  termed  "Bootstrapped  Algorithm”  is  proposed  and  analyzed,  and  its 
performance  is  evaluated  in  this  report.  Using  this  algorithm  as  an  interference  canceler 
results  in  structures  which  are  unique  in  that  they  are  composed  of  multi-cancelers;  each 
uses  the  outputs  of  other  cancelers  as  references  (desired  signals)  or  in  other  forms  to 
further  improve  performance.  As  a  result  of  such  unique  structures,  the  bootstrapped 
algorithm  is  shown  to  perform  as  a  "Signal  Separator"  rather  then  as  an  interference 
canceler.  Clearly,  because  it  does  not  require  a  reference  signal  in  the  form  of  decision 
feedback  or  training  sequence,  it  is  sometimes  justifiably  referred  to  by  the  term  "Blind 
Separator." 

Due  to  its  many  advantages,  one  might  consider  many  applications  for  such  blind  signal 
separators  ranging  from  neural  networks  and  pattern  recognition,  direction  finding  and 
general  signal  estimation  to  co-channel  interference  cancellation  and  cross  polarization 
interference  suppression.  After  we  present  a  thorough  examination  of  the  steady  state 
analysis  of  the  two-inputs  two-outputs  structures  without  noise,  we  consider  the 
bootstrapped  signal  separator  with  noise  present  as  a  signal  estimator  and  discuss  its 
properties. 

Application  to  cross-polarization  cancellation  in  M-QAM  dual-polarized  transmission  is 
thoroughly  discussed.  Improvement  of  error  probability  by  using  such  a  canceler  is 
quantified.  Because  of  its  importance  for  neural  network  applications,  extension  of  the 
bootstrapped  algorithm  to  multi-inputs  multi-outputs  is  also  examined. 

Convergence  properties  of  the  two-inputs  two-outputs  and  the  multi-inputs  multi-outputs 
cases  were  also  studied.  Finally  some  preliminary  results  of  the  algorithm  for  wide-band 
signal  cases  were  obtained. 

It  was  found  that  the  bootstrapped  algorithm  has  many  useful  properties  which  make  it  an 
excellent  candidate  for  use  as  a  signal  separator  or  interference  canceler  when  other 
algorithms  have  some  difficulties.  In  some  cases,  it  clearly  outperforms  other  algorithms. 
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1  Introduction 


Reported  below  axe  the  results  of  a  study  carried  out  at  the  Center  for  Communi¬ 
cations  and  Signal  Processing  Research,  NJIT,  between  March  1,  1991  and  June  30, 
1992.  The  aim  of  the  research  is  to  propose,  analyze  and  evaluate  the  performance 
of  a  fast  algorithm,  termed  “Bootstrapped  Algorithm. The  bootstrapped  algorithm 
for  interference  cancellation  was  first  proposed  by  the  principal  investigator  in  1981 

[1]  and  later  used  for  cancelling  cross  polarization  in  satellite  communication  [2]  and 
in  the  Microwave  Terrestrial  Radio  Link  [3-5].  Other  possible  applications  to  tactical 
communications  are  included  in  [6]. 

The  bootstrapped  interference  canceler  is  unique  in  that  it  is  composed  of  two 
separate  cancelers  each  using  the  output  of  the  other  canceler  as  its  reference  (desired 
signal)  input.  As  a  result  of  such  structure,  it  is  shown  to  perform  as  a  “Signal  Sepa¬ 
rator”  rather  than  an  interference  canceler.  Clearly,  as  such,  it  does  not  (like  regular 
LMS)  require  a  reference  signal  in  the  form  of  decision  feedback  or  training  sequence. 
Hence  sometimes,  the  term  “Blind  Separator”  is  used. 

Three  different  structures  are  proposed  in  Fig.  1;  (1)  Backward/Backward  (BB) 

(2)  Forward/ Forward  (FF)  and  (3)  Forward/ Backward  (FB).  These  are  the  three  pos¬ 
sible  interconnections  among  different  noise  cancelers.  The  adaptive  weights  for  these 
cancelers  can  be  controlled  by  minimizing  output  powers  or  minimizing  the  absolute 
value  of  the  cross  correlation  between  any  two  outputs  and  hence  sometimes  for  the 
two-input  two-output,  we  used  the  names  "Power- Power”  (PP),  "Power- Correlator” 
(PC)  and  "Correlator-Correlator”  (CC)  (see  Figs.  2,  3  and  4). 
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To  understand  the  behaviour  of  this  newly  proposed  algorithm,  one  must  discuss 
the  steady  state  and  show  that  under  accepted  conditions  it  converges  to  its  steady 
state  which  represents  the  desirable  signal  separation.  Effect  of  noise  on  the  behaviour 
of  the  algorithm  is  also  of  interest.  Looking  at  the  algorithm  as  an  estimator  of  the 
desired  signal,  one  might  also  be  interested  in  examining  the  properties  of  this  esti¬ 
mator  under  noise. 

Due  to  many  advantages,  one  might  consider  many  applications  for  such  a  blind 
signal  separator,  ranging  from  neural  networks  and  pattern  recognition,  direction 
finding  and  general  signal  estimation  to  co-channel  interference  cancellation  and 
cross  polarization  interference  suppression.  In  this  report,  after  studying  the  prin¬ 
ciple  property  of  the  algorithm  without  and  with  noise,  we  study  the  performance 
of  the  Backward/Backward  (BB)-  Power-Power  bootstrapped  cross-polarization  can- 
celer  and  compare  it  to  that  of  the  Diagonalizer  and  LMS  cancelers.  Performance 
study  of  the  other  two  structures,  i.e.  Forward /Forward  (FF)  -  Correlator-Correlator 
and  For  ward/ Backward  -  Correlator- Power  is  followed.  It  is  also  compared  with  that 
of  the  BB/PP  canceler. 

Clearly,  for  cross-polarization  cancellation  of  a  dual  polarized  channel,  we  are  in¬ 
terested  in  separating  two  orthogonal  signals  and  obtaining  at  the  outputs,  signals  as 
clean  as  possible  with  low  error  rates.  Hence,  we  examined  the  two-input  two-output 
case.  Extension  to  the  multidimensional  case  is  also  of  interest  particularly,  as  for 
example,  in  neural  network  applications.  This  was  first  done  with  the  BB  structure 
and  then  when  using  the  FB  and  FF  structure. 

The  convergence  properties  of  the  bootstrapped  algorithm  with  two-inputs,  two- 
outputs  and  multi-inputs,  multi-outputs  are  also  examined.  Finally  some  preliminary 


study  of  the  algorithm  for  wide-band  signal  is  started. 


It  was  found  that  the  bootstrapped  algorithm  has  many  useful  properties  which 
make  it  an  excellent  candidate  for  use  as  a  signal  separator  or  interference  canceler 
when  other  algorithms  have  some  difficulties.  In  some  cases,  it  clearly  outperforms 
other  algorithms. 

Section  (2)  below  is  a  technical  summary  of  the  study  and  its  results.  Detailed 
reports,  on  which  this  summary  is  based,  are  given  in  the  Appendices  of  this  doc¬ 
ument.  These  appendices  each  cover  a  specific  part  of  the  research  and  they  are 
written  in  a  way  that  can  be  read  independently  of  other  parts.  Section  (3)  contains 
the  conclusions  and  recommendations  for  further  study. 


2  Technical  Summary 

2.1  Bootstrapped  Algorithm  -  Two  inputs  -  Two  outputs 

2.1.1  Bootstrapped  Adaptive  Separation  of  Superimposed  Signals  -  Steady 
State  Analysis 

Consider  the  two  inputs  (in  complex  envelope  notation) 

fit*)  =  si(t)  +  bs2{t) 

v2{t)  =  csx(t)  +  s2{t)  (1) 

where  6  and  c  are  complex  values  and  jfe)2  and  |c|2  are  the  input  signal  to  interference 
ratios.  Si(f)  and  s2(t)  are  zero  mean  uncorrelated  stationary  complex  processes.  If  we 
process  these  two  inputs  by  using  Widrow's  noise  canceler, [7]  then  the  two  outputs 
will  follow  the  “power-inversion"  relation  with  respect  to  power  ratios  at  the  inputs 
to  the  weighted  elements  (see  Fig.  1  of  appendix  A).  Particularly,  when  |6|  and  |c| 
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are  less  than  unity,  as  in  a  cross  polxrization  interference  case,  this  canceler  is  useless. 
A  novel  way  to  obtain  a  high  signal  to  interference  ratio  at  both  output  ports  is 
to  use  a  bootstrapping  approach.  In  this  approach,  two  cancellation  paths  and  two 
summations  are  used  to  obtain  the  system  outputs,  and  an  adaptive  algorithm  is 
employed  to  optimize  the  signal- to- interference  power  ratio  at  the  two  output  ports 
simultaneously. 

Three  different  configurations  are  possible  for  a  bootstrapped  algorithm;  these 
are:  (see  Fig.  1) 

1.  The  Backward/Backward  (BB) 

2.  The  Forward/ Forward  (FF) 

3.  The  Forward /Back ward  (FB) 

Such  interconnections  between  the  two  “noise  cancelers’’  help  improve  the  perfor¬ 
mance  of  each  one  and  result  in  high  quality  signal  separation. 

In  order  to  control  the  adaptive  weights,  one  needs  optimization  criteria.  For  the 
two  inputs  two  outputs  case,  the  following  are  possible, 

1.  Power- Power 

2.  Power-Correlation 

3.  Correlation-Correlation 

In  the  first,  the  weights  are  controlled  by  minimizing  the  output  powers,  respectively. 
With  the  third,  the  absolute  values  of  the  cross  correlation  between  one  output  and  a 
modified  version  of  the  second  output,  and  versa  is  minimized.  The  second  criterion 
is  a  combination  of  both.  See.  for  example.  Fig.  2  wherein  the  backward/backward 
configuration  is  used  and  the  weights  are  controlled  by  minimizing  the  powers  at  the 
output. 
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To  understand  the  operation  of  this  particular  separator,  let  the  power  ratio  of 
the  two  signals  at  point  No. 3  be  such  that  s  >  n  (even  if  only  slightly  greater).  Point 
No. 3,  being  the  input  to  the  weighted  element  of  the  /?  processor,  (terminal  No.l, 
is  the  other  input)  will  result  (because  of  the  power-inversion)  in  n  >  s  at  point 
No.4  and  output  vp(t).  But  point  No. 4,  being  the  input  to  the  weighted  element  of 
the  q  processor,  (terminal  No. 2  is  its  other  input)  will  result  in  s  still  greater  than 
n  at  point  No.3  and  hence  at  output  port  vq(t).  This  process  of  bootstrapping  will 
continue  resulting  in  a  very  high  snr  at  one  port  and  a  very  high  nsr  at  the  other.  The 
snr  and  nsr,  at  these  ports  respectively,  will  be  upper  bounded  by  values  depending 
on  the  noise,  the  impurities  of  the  system  and  control  errors.  Consequently,  the 
power-power  canceler  of  Fig.  2  acts  as  a  high  quality  power  separator.  In  fact,  ideal 
separation  occurs  only  in  a  noise  and  impurity  free  case.  The  operation  of  the  other 
configurations  are  discussed  in  detail  in  Appendix  A. 

One  can  show  that  for  the  backward/backward  configuration,  power  or  correlation 
minimization  are  equivalent  and  either  or  both  of  them  can  be  used  to  control  the 
two  weights.  Th:  iur ward /forward  configuration’s  weights  can  only  be  controlled 
by  de-correlation.  The  feedback  arm  of  the  forward/backward  configuration  can  be 
controlled  by  either  minimizing  the  corresponding  power  output  or  by  de-correlation 
of  the  output  signals.  The  forward  arm  of  this  configuration  can  be  controlled  only 
by  de-correlation  (see  Fig  5  and  6). 

Appendix  A  of  this  report  contains  a  detailed  study  of  the  steady  state  analysis 
of  the  bootstrapped  adaptive  signal  separator.  This  analysis  concentrates  on  three 
configuration  -  optimization  structures. 

1.  Backward/Backward  -  Power/Power  which  for  simplicity  is  termed  "Power- 
Power" 

2.  Forward/ Backward  -  Power/Correlation  which  is  termed  uPower/Correlator" 
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3.  For  ward /For  ward  -  Correlator /Correlator  which  is  termed  Correlator/Correlator 

After  obtaining  the  optimum  complex  weights  of  the  three  different  bootstrapping 
configurations,  we  examine  the  conditions  under  which,  utilizing  an  adaptive  algo¬ 
rithm,  these  values  are  attainable.  It  is  shown  that  crucial  to  some  of  the  analytical 
results  is  the  assumption  that  the  input  de-polarization  is  always  much  less  than  one. 
The  optimal  signal  power  outputs,  for  the  different  configurations,  are  derived  and 
the  optimal  signal-to-interference  power  ratios  at  the  two  different  output  ports  are 
calculated  and  compared.  Also  calculated  and  compared  are  the  input-output  trans¬ 
mission  ratios  and  the  cancellation  factors  at  the  two  separate  ports.  Finally,  some 
other  questions  related  to  the  subject  of  this  paper,  namely  steady  state  analysis,  are 
raised. 

Finally,  we  make  the  following  remark  in  relation  to  performance  comparison  of 
the  three  bootstrapping  configurations  considered  in  this  report:  while  the  symmet¬ 
ric  power-power  and  correlation-correlation  schemes  produce  the  same  output  signal 
powers  and  power  ratios,  the  asymmetric  power- correlation  scheme  has  a  slightly  dif¬ 
ferent  signal  power  and  power  ratio  at  its  Q  port.  These  differences  are  only  of  a 
second  order  and  might  exist  only  if,  due  to  some  system  or  input  impurities  (Gaus¬ 
sian  noise,  quantization  error,  etc.),  the  ideal  optimal  conditions  are  not  reached. 
The  same  conclusion  is  in  effect  when  comparing  the  input-output  transmission  or 
cancellation  factors. 

Examination  of  Figures  2  through  4  reveals  the  fact  that  the  three  configura¬ 
tions  proposed  require  different  levels  of  hardware  complexity;  some  need  correlators 
(harder  to  implement)  other  require  power  measurements.  The  correlation-correlation 
scheme  is  expected  to  be  the  most  complex  while  the  power-power  scheme  the  least. 
Also,  different  signal  paths  (through  the  system’s  circuitry)  are  expected  to  result  in 
different  system  delays  with  the  different  configurations,  and  hence  different  band¬ 
width  limitations.  The  question  of  a  possible  trade-off  between  complexity  and  band- 
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width  is  raised.  This  will  be  addressed  in  a  subsequent  report. 

Gaussian  noise  effects  on  the  system  performance  and  the  analytical  results  of  this 
paper  should  also  be  considered.  In  particular,  it  is  important  to  investigate  the  limit 
on  cancellation  depth  and  hence  on  the  quality  of  power  separation  that  this  noise 
might  cause. 

The  above  items  are  problems  which  are  related  to  the  subject  of  appendix  A 
namely  steady  state  analysis;  but  they  will  be  reported  separately,  in  appendix  B. 
Finally  the  whole  subject  of  dynamic  analysis  must  be  investigated  for  the  three 
configurations. 

2.1.2  Bootstrapped  Adaptive  Separation  of  Superimposed  Signals  -  Effect 
of  Thermal  Noise  on  Performance 

The  effect  of  thermal  noise  on  performance  is  of  great  importance.  The  fact  that 
bootstrapped  algorithms  result  in  total  separation  of  two  superimposed  signals  when 
noise  is  not  present  needs  to  be  re-examined  when  thermal  noise  is  added.  This 
problem  is  dealt  with  in  appendix  B.  Again,  the  different  configurations  mentioned 
in  the  previous  section  are  considered.  From  the  study  of  the  general  case  of  multi¬ 
inputs,  multi-outputs,  the  analysis  in  this  appendix  is  then  concentrated  on  a  specific 
two  inputs-two  outputs  case.  In  doing  so,  the  effect  of  the  thermal  noise  on  separation 
performance  in  terms  of  the  output  desired-signal  to  overall  noise  ratio  is  presented. 
It  was  concluded  that  unless  signals  in  the  control  loops  are  somewhat  discriminated , 
the  separation  problem  can  not  be  solved.  On  the  other  hand,  perfect  separation  is 
obtained  for  infinite  signal-to-noise  ratio  (no  noise)  even  if  the  discrimination  is  slight. 

It  is  interesting  to  note  that  the  bootstrapped  algorithm,  besides  being  a  signal 
separator,  can  provide  an  estimate  of  the  model  parameters  (i.e  the  ratio  the  signals 
which  are  superimposed  at  the  input).  As  such,  the  question  is  what  kind  of  estimator 
are  we  dealing  with?  Without  noise  the  optimal  weights  converge  to  the  true  unbias 
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estimate  of  the  model  parameter.  Additive  thermal  noise  at  the  separator  inputs 
causes  bias  in  these  estimates.  This  bias  is  inversely  proportional  to  the  input  SNR 
and  increases  with  the  signal  cross  coupling.  The  bias  causes  degradation  in  the 
separation  performance,  but  this  degradation  is  small  if  |A| SNR  »  1,  where  A  = 
1  —  6c,  is  the  coupling  factor  (see  eqn.  (1)).  There  exist  many  practical  important 
separation  problems  for  which  lAjSA^f?  >>  1  (as  in  the  cross  polarization  example  of 
section  IV.  of  appendix  B).  Another  question  of  interest  when  using  the  bootstrapped 
algorithm  is,  what  happens  if  only  one  signal  is  present  ?  This  case  may  be  realistic  if 
one  of  the  signals  to  be  separated  is  temporarily  absent.  Discussion  of  this  in  appendix 
B  concludes  that  the  bootstrapped  algorithm  is  only  applicable  for  separation  of 
signals  and  not  for  noise  reduction,  etc.  (  as  in  the  LMS  algorithm). 

2.2  Bootstrapped  Algorithm  -  Application  to  Cross  Polar¬ 
ization  Cancellation 

2.2.1  “Power-Power”  Bootstrapped  Cross-Pol  Canceler  for  M-ary  QAM 
Signals  -  Performance  Evaluation  and  Comparison  with  LMS  and 
Diagonalizer 

M-QAM  dual-polarized  transmission  became  an  important  method  for  frequency 
re-use,  particularly  in  microwave  radio  communication.  However,  the  orthogonally 
polarized  waves  suffer  degradation  due  to  cross  polarization  interference.  Different 
canceler  structures  were  proposed  to  mitigate  the  effect  of  cross-polarization.  Among 
theses  are  the  Diagonalizer  and  the  LMS  [8].  The  bootstrapped  algorithm  is  another 
possible  signal  separator  for  dual  polarized  signal. 

In  appendix  C,  we  study  the  performance  of  the  “power-power”  structure  of  the 
bootstrapped  algorithm  discussed  in  section  2.1  and  compared  to  other  cancelers.  As 
dual  polarized  signals,  we  use  M-ary  QAM  modulated  signals  and  as  a  channel  we  use 
non-dispersive  fading  channel  where  the  depth  of  fading  varies.  To  dead  with  realistic 


8 


conditions,  we  also  add  thermal  noise  to  the  two  inputs  of  the  canceler.  Hence,  it  was 
necessary  to  re-examine  the  parameter  of  the  canceler  with  digital  data  (considered 
random  and  uncorrelated). 

As  a  performance  measure,  we  used  the  error  probability.  For  this  we  obtained 
the  Chemoff  upper  bound.  To  examine  the  tightness  of  these  we  derive  approximates 
to  the  error  probabilities  using  the  Gauss  Quadrature  method.  In  obtaining  our 
results,  we  assumed  two  kinds  of  output  compensation:  amplitude  only  compensation 
(automatic  gain  control,  AGC)  and  amplitude  together  with  phase  compensation 
(AGC  and  output  equalizer). 

Many  results  of  simulation  and  computer  numerical  calculations  are  included  in 
appendix  C.  From  these  we  conclude  that,  as  expected,  16  QAM  performance  is 
much  better  than  64  QAM.  It  is  also  shown  that  adding  phase  compensation  to  the 
canceler  output  adds  very  little  to  the  performance  obtained  when  only  amplitude 
compensation  is  included. 

From  comparing  the  results  obtained  with  the  moment  generating  method  to 
the  corresponding  Chernoff  bound,  we  concluded  that  these  bounds  are  sufficiently 
tight.  Comparing  the  results  when  different  numbers  of  moments  are  used,  and  the 
concluded  tightness  of  the  Chernoff  bound,  we  infer  that  approximately  10  moments 
are  sufficient  for  deriving  a  good  approximation  for  the  average  probability  of  error 
using  the  Gauss  quadrature  rule. 

The  performance  of  these  three  cancelers  is  compared  numerically  in  Fig.  7  and 
Fig.  8  for  the  16  QAM  with  r=-10  dB  and  -5  dB,  respectively.  Since  the  diagonalizer 
is  shown  to  be  useless  for  the  64  QAM,  we  only  compare  the  LMS  and  power-power 
configuration  with  64  QAM  in  Fig.  9  and  10.  It  is  also  clear  from  these  figures  that 
the  LMS  canceler  outperforms  the  diagonalizer. 

The  LMS  canceler  outperforms  the  diagonalizer  particularly  when  the  cross  cou¬ 
pling  is  high.  Therefore,  in  the  following  figures,  we  compare  the  difference  in  perfor- 
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mance  between  the  power-power  and  LMS  when  using  16  QAM  and  64  QAM.  This  is 
done  in  Figs.  11,  12  and  13  when  r=-15  dB,  -10  dB  and  -5  dB,  respectively.  Except 
for  a  very  low  signal-to-noise  ratio,  the  power-power  outperforms  the  LMS  with  64 
QAM,  more  than  with  16  QAM. 

2.2.2  Performance  Comparison  of  Three  Bootstrapped  Cross-Pol  Can- 
celers  for  M-ary  QAM  Signals 

In  appendix  D  we  study  the  error  probability  performances  of  another  two  boot¬ 
strapped  structures,  namely  the  "Power-Correlator”  and  “Correlator-Correlator”  when 
they  are  used  to  cancel  cross  polarization  interference  of  dual  channel  M-ary  QAM 
signals.  As  in  dealing  with  the  "Power-Power”  structure,  we  use  the  Chernoff  upper 
bound  and  Gauss  Quadrature  method  to  estimate  the  error  probability  as  a  function 
of  signal-to-noise  ratios. 

From  the  results  of  this  study,  we  conclude  that  the  bootstrapped  Power- Power 
structure  outperforms  the  Correlator-Correlator  and  Power- Correlator  structures, 
particularly  when  the  cross  coupling  is  high,  such  as  -10  dB.  Also,  notice  that  the 
performance  at  the  two  outputs  of  the  Power- Correlator  structure  is  not  the  same. 
The  performance  at  one  output  is  the  same  as  that  of  the  Power- Power  and  the  other 
output  performance  is  close  to  the  performance  of  the  Correlator-Correlator  structure. 

In  Fig.  14,  we  depict  a  performance  comparison  of  the  three  bootstrapped  struc¬ 
tures  with  that  of  the  LMS  cross  polarization  canceler.  From  this  figure,  it  is  clearly 
shown  that  the  Power- Power  canceler  scheme  performs  better  than  the  others,  while 
LMS  performs  better  than  that  of  the  Correlator-Correlator  and  that  of  output-2  of 
the  Power- Correlator  structure. 
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2.3  Bootstrapped  Algorithm  -  Multi-Inputs  Multi-Outputs 
Separator 

Beside  the  cross-polarization  cancellation  which  requires  only  two  inputs-two  out¬ 
puts  structures  and  other  applications  such  as  in  neural  networks  and  signed  separation 
of  multi  channel  CDMA,  there  is  a  need  for  multi-inputs  multi-outputs  separators. 
Obviously,  one  can  do  with  multi  LMS  cancelers  when  each  delivers  one  signal  and 
cancels  all  the  others.  This  approach  becomes  very  complex  when  the  number  of 
inputs  and  outputs  becomes  large,  beside  its  inferiority  in  performance  in  comparison 
to  the  bootstrapped  algorithms  which  is  discussed  in  this  section. 

2.3.1  Multi-Inputs,  Multi-Outputs  Separator  Using  the  Feedback/Feedback 
Bootstrapped  Structure 

In  appendix  E.  we  present  the  extension  of  multi-inputs,  multi-outputs  of  the 
feedback/feedback  structure  (see  Fig.  15).  As  an  optimum  criteria  for  controlling  the 
weights,  we  used  the  minimization  of  correlation  between  one  output  and  the  cubic 
of  the  other  outputs.  Beside  the  complexity  advantage  of  the  bootstrapped  structure 
to  the  LMS  and  the  fact  that  the  second  needs  supervisory  reference  while  the  first 
does  not,  we  studied,  in  this  part  of  the  research,  the  speed  of  convergence  property 
of  the  bootstrap  in  comparison  to  the  LMS  algorithm. 

It  was  shown  by  simulation  that  the  learning  process  of  the  bootstrap  signal 
separator,  though  requiring  fewer  weights,  is  faster  than  the  LMS  algorithm.  This  is 
true  especially  at  a  high  signal-to-interference  (SIR)  ratio.  The  learning  process  of 
the  bootstrapped  algorithm  is  almost  independent  of  the  SIR  and  converges  within  a 
reasonably  small  number  of  iterations.  That  is,  the  bootstrapped  algorithm  is  almost 
independent  of  the  eigenvalue  spread  of  the  input  correlation  matrix. 
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2.3.2  Convergence  and  Performance  Comparison  of  Three  Different  Struc¬ 
tures  of  Bootstrapped  Blind  Adaptive  Algorithm  for  Multi-signal 
Co-Channel  Separation 

In  appendix  F,  we  present  the  multi-inputs  multi-outputs  extension  of  the  other 
two  bootstrapped  structures,  “Power-Correlator”  and  “Correlator- Correlator”  (see 
Fig.  16  and  17).  Performance  of  the  separators  is  studied  and  compared  by  examining 
the  depth  of  interference  residue  at  each  output  and  by  considering  the  speed  of 
convergence.  Effect  of  compensation  via  AGC  on  the  separator  performance  is  also 
considered.  As  in  the  Power-Power  structure  discussed  in  the  previous  section,  the 
optimum  criteria  for  controlling  the  weights,  we  used  minimization  of  correlation  of 
the  outputs  with  cubic  non-linearities. 

For  channel  inputs  we  used  random  bipolar  independent  sequences.  Channel  pa¬ 
rameters  were  chosen  to  present  different  desired  SIR  ratios  at  the  channel  outputs. 
These  parameters  determine  the  canceler’s  input  correlation  matrix  and  hence  the 
matrix  eigenvalue  spread.  Thermal  noise  was  also  added  to  the  output  of  the  chan¬ 
nel. 

The  optimum  weights  for  all  three  separators  were  found  analytically  in  the  ab¬ 
sence  of  noise.  The  signal  separation  process  was  shown  via  simulation  by  the  outputs 
learning  curves.  These  learning  curves  of  the  Power-Power  separator  is  compared  to 
the  three  outputs  learning  curves  of  the  Power- Correlator  separator  when  AGC  is 
added  to  these  outputs  (see  Fig  18).  It  was  also  shown  that  the  three  different  boot¬ 
strapped  separators  converge  to  their  steady  state  almost  with  the  same  speed  for 
two  or  three  signals,  lowest  for  Power- Power  and  highest  for  Correlator-Correlator. 
One  output  of  Power-Correlator  results  in  residue  similar  to  that  of  the  Correlator- 
Correlator.  However,  adding  AGC  to  the  Correlator-Correlator  outputs  or  to  one  of 
the  outputs  of  the  Power-Correlator  which  reduces  the  amount  of  residue,  so  that 
when  AGC  was  added  (when  it  was  needed),  all  separators  behaved  similarly. 
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2.4  Bootstrapped  Algorithm  -  Wideband  Signal  Separator 

For  superimposed  wideband  signals  we  suggest  a  bootstrap  structure  whose  con¬ 
trolled  elements  are  delays  instead  of  complex  weights  or  digital  filters.  In  principle, 
the  structure  is  the  same  as  the  backward/backward  structure  discussed  in  earlier  sec¬ 
tions  (see  Fig.  19).  It  is  shown  in  appendix  G  that  if  the  source  locations  are  known 
then  the  proposed  system  provides  a  least  square  estimate  of  the  source  signals.  This 
suggests  that  the  backward/backward  structure  provides  a  simple  implementation  of 
the  least  square  multisource  estimator.  Such  an  estimator,  regularly  implemented  by 
a  maximum  likelihood  approach,  requires  a  complex  set  of  software  algorithms. 

If  the  source  locations  are  unknown,  the  algorithm  suggested  in  appendix  G  con¬ 
verges  to  the  least  square  solution,  provided  that  some  prior  information  about  the 
source  signal  is  available.  Hence,  we  show  that  the  bootstrapped  algorithm  with  time 
delay  control  can  be  used  for  the  separation  of  wideband  superimposed  signals. 

First,  the  general  wideband  multi-source  model  of  the  problem  is  defined.  It 
assumes  having  N  point  sources  received  by  M  omnidirectional  sensors.  This  model 
is  practical  in  passive  sonar  wherein  the  signals  are  wideband,  noise  -like  random 
processes  and  the  unknown  source  location  is  to  be  estimated.  In  active  sonar,  the 
signals  are  known  and  we  are  interested  in  estimating  the  source  location.  However, 
in  wideband  communication  one  is  usually  interested  in  the  source  signals  themselves 
and  not  in  their  location. 

Working  in  the  frequency  domain  we  first  present  the  expression  for  the  least- 
square  estimate  of  the  vector  of  the  source  signal.  Using  this  expression  we  depict 
the  direct  block  diagram  that  implements  this  estimator.  Restricting  our  analysis  to 
M  =  N  —  2  it  is  shown  that  even  when  the  directions  of  the  two  sources  are  known 
one  needs  to  transfer  function  of  the  form  of  cosu>A  or  1/  sin2 a? A  as  well  as  delay  (see 
Fig.  1  of  appendix  G).  Our  bootstrapped  approach  will  remedy  this  problem  and  we 
only  need  delay  elements  and  summers. 
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We  show  that  with  feedback  structure  the  expression  for  the  least  square  can  easily 
be  implemented  (Fig.  19),  if  we  know  the  location  of  the  sources.  If  these  locations 
are  unknown  then  we  must  use  an  estimate  of  these  locations.  The  bootstrapped 
algorithm  can  be  used  to  estimate  these  locations.  In  fact,  the  controlled  delays 
at  the  feedback  path  of  the  backward/backward  structure  will  give  us  an  estimate 
of  the  delay  propagation  of  the  signals’  waves  impinging  on  the  array  and  hence 
directly  related  to  these  signals’  directions  of  arrival.  When  the  algorithm  controlling 
these  delays  reaches  its  steady  state,  the  outputs  of  the  separator  will  each  deliver 
sufficiently  clean  signals  at  only  one  output. 

3  Conclusions  and  Recommendations 

We  have  seen  that  the  bootstrapped  algorithm  has  properties  which  make  it 
attractive  for  many  applications  of  signal  separation.  Without  noise  the  separation  is 
ideal.  Adding  noise  will  degrade  the  performance  however,  for  signal  estimation  this 
degradation  is  tolerable.  Furthermore,  the  algorithm  has  the  property  to  converge 
to  its  steady  state  where  signal  separation  occurs  much  faster  than  other  algorithms. 
Unlike  other  algorithms  the  speed  of  convergence  does  not  depend  on  the  signal  power 
ratio  and  hence  does  not  depend  on  the  eigenvalues  spread  of  the  input  correlation 
matrix.  It  is  also  important  to  note  that  the  algorithm  does  not  require  a  supervisory 
reference  signal.  Hence  in  this  regard,  it  is  a  blind  signal  separator. 

In  this  research  we  studied  three  structures  of  this  algorithm  and  discussed  pos¬ 
sible  optimization  criteria  for  each.  The  case  of  two-inputs,  two  outputs  was  studied 
in  detail,  particularly  as  it  is  applied  to  the  problem  of  separating  two  signals  con¬ 
taminated  with  cross-polarization  interference.  When  handling  M-ary  QAM  signal 
we  estimate  error  probabilities  without  a  canceler  and  with  different  cancelers.  one  of 
which  was  the  bootstrap  separator.  It  was  shown  that  the  bootstrapped  structures 
always  outperform  other  cancelers. 
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The  bootstrapped  structures  were  also  extended  to  multi-inputs  multi-outputs, 
and  shown  to  have  similar  properties  as  the  two-inputs  two-outputs  case.  For  op¬ 
timization  criteria  we  use  de-correlation  of  outputs  with  cubic  nonlinearity.  As  an 
application  of  multi-inputs  we  considered  superimposed  signal  with  uncorrelated  dig¬ 
ital  data  and  for  performance  we  again  examined  error  probabilities. 

Some  work  was  also  done  with  wideband  signals.  When  using  delay  control  in  the 
bootstrapped  algorithm,  we  could  prove  the  very  interesting  result  that  this  algorithm 
exhibits  a  simple  hardware  implementation  of  Least  Squares  estimator. 

The  work  carried  out  led  us  to  make  a  number  of  recommendations  for  further 
study: 

1.  Two  Input-Two  Output  Bootstrapped  Algorithms 

*  Study  performance  of  the  bootstrapped  structure  for  cross-pol  cancellation  of 
dispersive  channels.  Examine  error  probability  and  suggest  co-pol  compensation 
whenever  needed. 

*  Further  study  the  dependency  of  the  bootstrapped  algorithm  on  the  equivalent 
system  eigenvalues  spread  to  facilitate  comparison  with  LMS  on  one  hand  and 
eigen  analysis  on  the  other. 

*  Compare  the  complexity  of  this  algorithm  to  those  of  other  algorithms  and  draw 
conclusions  regarding  its  implementation  with  software  or  hardware,  digital  or 
analog. 

*  Although  bootstrapped  algorithms  do  not  require  supervisory  inputs,  it  is  im¬ 
portant  to  examine  what  improvement  in  performance  one  can  get  if  such  input 
signals  are  used. 

*  Study  dynamic  performance  of  the  three  structures  and  examine  possible  im¬ 
plementation  in  analog  hardware. 
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2.  Multi-Input  Multi-Output  Bootstrapped  Algorithm 

*  Further  effort  is  needed  to  study  error  probabilities  of  multi-signal  interference. 

“  Analysis  of  these  cases  should  be  completed  and  conclusions  regarding  their 
performance,  complexity  and  implementation  should  be  drawn. 

*  Applications  of  multi-signal  co-channel  cancellation  should  be  sought. 

“  Examine  possible  application  for  neural  network  implementation. 

*  Study  speed  of  convergence  and  depth  of  cancellation  and  their  dependency  on 
the  number  of  signals  being  processed. 

3.  Wideband  Application  of  Bootstrapped  Algorithms 

x  Further  study  the  bootstrapped  time  delay  estimation  of  two  uncorrelated  sources. 

*  Extend  this  work  to  multi-input  multi-output. 

*  Examine  implementation  of  such  estimators  for  adaptive  wideband  interference 
canceler  and  for  the  signal  separator. 

*  Establish  the  requirement  for  stable  robust  control  loops. 

*  Examine  the  performance  of  these  estimators  and  cancelers  under  different  en¬ 
vironmental  conditions  and  with  different  wideband  signal  modulation. 

x  Compare  performance  of  these  estimators  to  those  of  maximum  likelihood  and 
eigenanalvsis  estimators. 

x  The  above  would  be  done  using  analysis  and  supported  by  the  needed  simula¬ 
tions. 
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4.  The  Bootstrapped  Algorithm  as  a  Blind  Adaptive  Equalizer 

Blind  equalization  is  a  channel  equalizer  where  the  reference  signal  is  obtained 
directly  from  the  channel  output  instead  of  by  using  a  pilot,  training  sequence,  or 
decision  feedback.  Such  an  approach  has  the  drawback  of  being  non-adaptive  and 
lacks  the  capability  of  following  environmental  variation.  We  suggest  using  the  desired 
signal  extracted  from  one  bootstrapped  algorithm  as  a  supervisory  signal  for  the  blind 
equalizer.  It  is  believed  that  such  an  approach  will  reduce  many  problems  that  current 
blind  equalizers  have. 
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Fig-1 :  The  three  configuration  of  the  bootstrapped  signal  separator 

a.  Backward /Backward  Structure 

b.  Forward /Forward  Structure 

c.  Forward/Backward  Structure 
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Fig.  2  Power- 
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Fig.  3  Power-Correiation  bootstrapped  canceier 
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input  #2: 

v2(t)=c-s(t).n(t) 


Fig.  4  Correlation-cororrelation  bootstrapped  canceier 


Fig.  6  Optimization  Criteria  for  Forward  Forward/Forward  and  Backward/Forward 
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Fig.  7  Performance  comparison  of  Bootstrap,  LMS  and  Diagonalizer  16  QAM. 
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Fig.  8  Performance  comparison  of  Bootstrap,  LMS  and  Diagonalizer  16  QAM,  r=-5 
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Fig.  9  Performance  comparison  of  Bootstrap  and  LMS.  64  QAM,  r=-10  dB 
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Bootstrap  and  LMS  Algorithm  Comparison 
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Fig.  10  Performance  comparison  of  Bootstrap  and  LMS,  64  QAM.  r=-5  dB 
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Fig.  11  Bootstrap  and  LMS  Performance  Difference  64  QAM,  r=-15  dB 
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Fig.  12  Bootstrap  and  LMS  Performance  Difference  64  QAM,  r=-10  dB 
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Fig.  13  Bootstrap  and  LMS  Performance  Difference  64  QAM.  r=-5  dB 
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Fig.  14  Comparison  of  the  Cross-pol  Cancelers  with  LMS  Canceler 
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Fig.  17  Multi-Inputs  Multi-Outputs  Backward/Forward  Separator 
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RESIDUE  POWER,  dB 


Fig.  18  Convergence  Comparison  of  the  Bootstrapped  Signal  Separators 
for  three-inputs/three-outputs 
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Fig.  19  Bootstrapped  Implementation  of  the  Least-Squares  Separator. 


Appendix  A 


Bootstrapped  Adaptive  Separation  of  Two  Superimposed  Signals  - 

Steady  State  Analysis 


Y.  Bax-Ness 


Abstract 

The  algorithm  presented  here  differs  from  other  interference  cancellation  systems 
in  that  it  is  a  power  separator  rather  than  an  interference  canceler.  That  is,  each 
of  the  two  input  signals  interferes  with  the  other  and  the  function  of  the  canceler  is 
to  remove  that  interference  from  both  input  signals  rather  than  just  one.  A  novel 
way  to  obtain  high  signal  to  interference  ratio  at  both  output  ports  is  to  use  the 
bootstrapping  approach. 

Three  bootstranped  configurations  are  discussed  and  analyzed  herein.  They  par¬ 
ticularly  differ  in  the  criteria  used  to  obtain  the  optimal  complex  weight  in  the  can¬ 
cellation  path. 

Steady  state  parameters,  such  as  optimal  complex  weights,  optimal  signal  power 
outputs  and  signal- to- interference  power  ratios  are  derived  for  each  of  the  different 
configurations.  Also  calculated  axe  input-output-signal  transmission  and  cancellation 
factors.  In  performing  the  analysis,  emphasis  is  on  application  for  cross-polarization 
cancellation. 
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1  Introduction 

System  degradations  in  dual  orthogonally  polarized  communication  systems  may 
be  reduced  by  the  use  of  a  cross-pol  interference  canceler.  A  cross  pol  canceler  differs 
from  other  interference  cancellation  systems  [1,2]  in  that  it  is  a  power  separator  rather 
than  an  interference  canceler.  That  is,  #*ach  of  the  two  input  signals  interferes  with  the 
other  and  the  function  of  the  canceler  is  to  remove  that  interference  from  both  input 
signals  rather  than  just  one.  A  novel  way  to  obtain  a  high  signal  to  interference  ratio 
at  both  output  ports  is  to  use  a  bootstrapping  approach  [3.4].  In  this  approach  two 
cancellation  paths  and  two  summations  are  used  to  obtain  the  two  system  outputs, 
and  an  adaptive  algorithm  is  employed  to  optimize  the  signal-to-interference  power 
ratio  at  the  two  output  ports  simultaneously. 

The  purpose  of  this  appendix  is  to  report  a  detailed  steady  state  analysis  of  the 
three  bootstrapped  configurations,  two  of  which  were  first  discussed  in  [3]  and  [4]1. 
A  summary  of  the  results  of  this  appendix  is  previously  reported  in  the  literature  [5]. 
Independently,  during  the  mid-eighties,  a  group  of  European  researchers  addressed 
the  same  separation  problem  and,  under  the  name  of  “blind  signal  separation”  devel¬ 
oped  a  similar  adaptive  system  [6].  More  recently,  a  third  group  of  signal  processing 
researchers  have  applied  similar  ideas  to  speech  signal  separation  [7]. 

The  three  configurations  suggested  in  the  appendix  differ  particularly  in  the  crite¬ 
ria  used  to  obtain  the  optimal  complex  weight  in  the  cancellation  path.  The  criteria 
used  minimize  either  the  interfering  signals  power  at  the  two  output  ports,  the  cor¬ 
relation  between  the  two  signals  at  the  two  output  ports,  or  simultaneously  the  in¬ 
terfering  signal  power  at  one  port  and  the  correlation  between  the  two  output  signals 
at  ports.  Correspondingly  they  will  be  termed:  1)  power-power,  power- correlation 
and  correlation-correlation  cross  pol  cancelers.  Consequently,  the  three  configura¬ 
tions  differ  in  the  topology  of  their  two  cancellation  paths,  and  the  manner  in  which 
xThis  work  in  reference  [3]  did  not  consider  the  cross  polarization  problem. 
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the  adaptive  feedback  information  is  derived  and  hence  in  their  hardware  complex¬ 
ity.  The  use  of  either  of  these  criteria  would  lead  to  the  customary  power-inversion 
result.  However,  each  of  the  above  bootstrapping  arrangements  results  in  power  sep¬ 
aration  (high  signal-to-interference  ratio  at  both  output  ports)  through  the  use  of  a 
discrimination  technique. 

In  this  appendix  we  obtain  the  optimal  complex  weights  of  the  three  different 
bootstrapping  configurations,  and  examine  the  conditions  under  which,  utilizing  an 
adaptive  algorithm,  these  optimal  values  are  attainable.  It  is  shown  that  crucial 
to  some  of  the  analytical  results  is  the  assumption  that  the  input  de-polarization 
is  always  much  less  than  one.  The  optimal  signal  power  outputs,  for  the  different 
configurations,  are  derived  and  the  optimal  signal-to-interference  power  ratios  at  the 
two  different  output  ports  are  calculated  and  compared.  Also  calculated  and  com¬ 
pared  are  the  input-output  transmission  ratios  and  the  cancellation  factors  at  the  two 
separate  ports.  Finally  some  other  questions  related  to  the  subject  of  this  appendix, 
namely  steady  state  analysis,  are  raised.  These  will  be  investigated  and  reported 
separately. 

Consider  the  two  inputs  (in  complex  envelope  notation) 

uj(t)  =  s(t)  +  bn(t) 

v  2{t)  =  cs{t)  +  n(t)  (1) 

where  b  and  c  are  complex  values  and  |6|2  and  |c|2  are  the  input  signal  to  interference 
ratios.  s(t)  and  n(t)  are  zero-mean  uncorrelated  stationary  complex  processes.  We 
will  not  indicate  the  time-dependence  of  variables  in  the  interest  of  brevity  unless  it 
is  necessary.  We  now  process  these  two  inputs,  separately  using,  the  simple  “noise 
cancelling"  scheme  proposed  by  Widrow  [1]  (see  Figure  1).  Here  we  consider  each 
input  as  a  “reference  signal”  (in  Widrow’s  terminology)  and  sum  it  with  a  weighted 
version  of  the  other  signal  to  form  an  output.  Two  such  outputs  r,(f)  and  vp(t)  are 
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formed  simultaneously.  The  corresponding  weights  a  and  /3  (complex  valued  )  can 
adaptively  be  adjusted  so  that  the  output  powers  Q  and  P  are  minimized,  respectively. 


From  Figure  1  we  have 


Vg(t)  =  U2(t)  +  QU](t) 


Q  -  M<)P  =  |e  +  ct\2\s\2  +  !l  +  ba\2\n\2  (3) 

where  the  over-bar  stands  for  the  expected  value.  Therefore,  |s|2and  |n|2  designate 
the  powers  of  the  two  incoming  signals  respectively.  Thus,  one  can  show  that, 

^  =  2(c +  «)£?  + 2(1 +6a)6'W  (4) 

da 

where  the  derivative  of  a  real  function  with  respect  to  (w.r.t.)  a  complex  variable 
a(a  =  an-rjai)  is  defined  by;  d(.)/dt  =  d(.)/dan+jd(.)/dai.  2  The  asterisk  denotes 
complex  conjugate  and  j  =  y/—l.  Equating  (4)  to  zero  we  obtain  the  optimal  value 


c|»p  +  Hn|» 

”P  l»l!  +  IW 

Substituting  in  (3)  we  obtain  the  power  of  the  s  signal  Q3  and  of  the  n  signal  Qn. 
These,  following  simple  manipulation,  are  given  by, 


Qs  =  - 


6*(1  —  cfe)M2/|s|2  ‘ 

1  +  |6|2|n|2/|s|2  'S| 


_  (I-cb)  2  — 
Qn  1  +  |&!2|n|2/|s!2  |n| 


and  the  n  signal-to-s  signal  power  ratio  is 


Qn/Qs  —  |,.2t— rj  (®) 

[6|2|n|2 

2In  obtaining  the  complex  derivative  of  a  real  function  A  =  \d+eb\7  w.r.t.  to  the  complex  variable 
6  we  used  the  simple  general  rule;  dA  -  2 e*(d  +  tb) 
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(9) 


vp(<)  =  ui(t)  +  au2(t) 

P  =  MOP  =  |6  +  +  |1  +  0c\2W  (10) 


so  that 

_  6|n[2  -f  c*|sp 

°P  |nP  +  |c|2|s|2 


The  power  of  the  s  signal  and  the  n  signal  are,  respectively; 


(11) 


c*(l  —  d>)|s[2/|n|2 

1  +  rnvw 


(12) 


and 


Ps  = 


(1  -  cb) 

1  +  |c|2|s|2/|n|2 


(13) 


P3/Pn  =  |nP/|c|2|sP 


(14) 


Like  (8),  equation  (14)  represents  a  “power  inversion”  relation  with  respect  to  the 
power  ratio  at  the  input  to  the  weighted  elements.  In  fact,  if  |c|  ^  |6|  then  we 
expect  an  improvement  in  power  ratio  of  one  signal  to  the  other  at  one  port,  while 
a  degradation  of  the  power  ratio  of  the  second  signal  to  the  first  at  the  second  port. 
For  example,  if  |6|  <  |c|  then  Qs/Qn  is  greater  than  the  s  signal-to-n  signal  power 
ratio  (snr)  at  input  terminal  No.  1, while  Pn/P3  is  less  than  n  signal-to-s  signal  power 
ratio  (nsr)  at  input  terminal  No.2. 

Similar  results  prevail  if  instead  of  the  criterion  of  minimizing,  separately,  the  out¬ 
put  powers  Q  and  P  we  would  implement  the  criterion  of  minimizing  the  correlation 

of  each  output  with  the  corresponding  input.  That  is  to  adjust  a  and  /?  so  that, 
- 2  - 2 

vq(t)vi(t)  and  vp(t)v2(t)  are  minimized  respectively.  (See  Fig.  1) 
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In  conclusion,  the  “noise  cancelling”  scheme  can  not  be  used  in  cross  polarization 
problems  where  high  quality  power  separation  is  required,  i.e.  improvement  in  both 
snr  at  one  port  and  nsr  at  the  other.  This  motivates  one  to  explore  the  bootstrapping 
approach  wherein  the  general  idea  is  to  feedback  the  power- inverted  “noise  canceler” 
output  as  a  “reference  signal”  for  the  other  “noise  canceler”  and  vice  versa.  Suitable 
feedback  arrangements  enhance  the  right  power  ratios  resulting  in  power  separation 
with  high  signal-to-interference  ratios  at  both  output  ports. 

2  Bootstrapping  Techniques 

2.1  Optimization  Criterion 

In  this  section  we  investigate  three  bootstrapping  configurations  in  which  the 
following  optimization  criterion  are  employed,  these  are: 

1.  Power- Power  criterion 

2.  Power-Correlation  criterion 

3.  Correlation-Correlation  criterion 

These  configurations  are  depicted  in  Figures  2  through  4  respectively.  The  first 
configuration  follows  Bar-Ness  and  Rokach  [4],  the  second  was  considered  in  un¬ 
published  communications  by  Steinberger,  while  the  third  resembles  the  cancellation 
network  proposed  by  Brand  wood  [3].  Notice  the  discrimination  networks  in  these 
configurations.  Such  a  discriminator  which  depends  on  the  properties  of  the  signals 
may  turn  out  to  be  a  limiter,  filter,  etc.  Its  sole  effect  is  to  slightly  emphasize  one 
signal  with  respect  to  the  other.  Their  necessity  will  be  obvious  later.  In  references 
[3]  and  [4]  where  narrow  band  signals  were  assumed,  hard  limiters  were  implemented 
as  discrimination  techniques.  Computer  simulations  have  shown  that  limiters  are 
only  effective  in  a  narrow  class  of  applications  [5].  For  satellite  communication  [5] 
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in  which  the  frequency  plans  for  the  two  polarizations  are  staggered,  a  frequency 
discrimination  technique  [8]  with  simple  comb  filter  was  used. 

Consider  the  power-power  canceler  of  Figure  2.  Let  the  power  ratio  of  the  two 
signals  at  point  No.  3  be  such  that  s  >  n  (even  if  only  slightly  greater).  Point  No.  3 
being  the  input  to  the  weighted  element  of  the  0  processor  (terminal  No.  1  is  the  other 
input)  will  result  (because  of  power-inversion)  in  n  >  s  at  point  No.  4  and  output. 
vp(t).  But  point  No.  4  being  the  input  to  the  weighted  element  of  the  a  processor 
(terminal  No.  2  is  its  other  input)  will  result  in  s  still  greater  than  n  at  point  No.  3 
and  hence  at  output  port,  u9(t).  This  process  of  bootstrapping  will  continue,  resulting 
in  a  very  high  snr  at  one  port  and  a  very  high  nsr  at  the  other.  The  snr  and  nsr,  at 
these  ports  respectively,  will  be  upper  bounded  by  values  depending  on  the  noise,  the 
impurities  of  the  system  and  control  errors.  Consequently,  the  power-power  canceler 
of  Figure  2  acts  as  a  high  quality  power  separator.  In  fact  ideal  separation  occurs 
only  in  a  noise  and  impurity  free  case. 

In  the  cross  pol  canceler  of  Figure  3,  the  cancellation  weight  0  is  controlled  via 
a  power  criterion  which  minimizes  the  power  P  at  the  vp(t)  port.  The  weight  a  is 
controlled  by  minimizing  the  correlation  between  the  two  outputs  (i.e.  |v9(f)o*(f)|  ) 
thus,  the  name  power-correlator  canceler.  Here,  to  obtain  a  perfect  cancellation  of  the 
n  signal  at  vp(t),  it  is  required  that  the  0  processor  has  a  clean  sample  of  n  signal  at 
point  No.  3  (because  of  power-inversion  behavior).  The  correlation  processor  which 
controls  a  can  operate  with  a  sample  of  the  signal  n  (at  point  No.  3)  which  is  corrupted 
by  the  signal  s.  but  needs  a  clean  sample  of  the  signal  s  (at  the  other  correlator  input) 
to  generate  its  feedback  signal.  Since  one  of  the  two  processors  (the  correlation)  can 
in  effect  defer  its  need  for  a  clean  sample  of  the  signal  n,  it  makes  sense  to  let  that 
processor  perform  its  cancellation  first,  making  a  clean  sample  of  n  available  to  the 
other  processor  (power  processor),  which  in  turn  provides  a  clean  sample  of  the  signal 
s  (at  point  No.  4)  to  the  first  processor  (correlation  processor)  to  generate  a  feedback 
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signal.  Thus,  although  neither  processor  can  function  properly  unless  the  other  one 
does,  both  (in  bootstrap  operation)  can  operate  properly  together.  Consequently, 
the  power-correlator  canceler  of  Figure  3  can  perform  as  a  power  separator.  It  might 
seem  complicated  to  comprehend  such  a  qualitive  argument,  nevertheless  analysis  will 
support  these  claims. 

Finally,  the  correlator-correlator  canceler  of  Figure  4  operates  as  follows:  The  a 
processor  can  operate  with  a  sample  of  the  single  n  (at  point  No.  3)  which  is  corrupted 
by  the  signal  s,  but  needs  a  clean  sample  of  the  signal  s  (at  point  No.  4)  to  generate 
its  feedback.  Similarly  with  the  3  processor,  where  the  signals  n  and  s  (at  the  point 
No.  3  and  No.  4)  are  interchanged.  Since  initially  neither  points,  No.  3  or  No.  4 
contains  a  clean  sample  of  s  or  n.  respectively,  neither  processor  performs  properly 
unless  the  other  one  does.  However,  if  one  processor  starts  its  cancellation  it  results 
in  a  cleaner  sample  of  the  proper  signal  needed  by  the  other  processor  and  vice  verse. 
This  bootstrapping  behavior  finally  results  in  the  desired  power  separation  at  the 
output  ports. 

2.2  The  Optimal  Weights 

The  optimal  weights  for  the  different  configurations  are  now  obtained  using  the 
corresponding  optimization  criterion 

2.2.1  The  Power- Power  Scheme 

From  Figure  2, 


t>(0  =  vi(<)  +  3vq(t) 

(15) 

vq(t)  =  v2(t)  -1-  QVp(t) 

(16) 

By  using  (1)  we  get, 
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p  =  MOP- 


|1  4-  Pc\2\s\2  4- 16  4-  /9p|np 

|1  -  *P\2 


where  we  used  the  fact  that  s(0  and  n(t)  are  zero-mean  uncorrelated  processes. 
Taking  the  derivative  of  (17)  we  get 

dp  2(1  -  ap)[(l  4-  0c)(a  +  c)*|7p  +  (b  +  p)(  1  +  a6)‘M] 
dp  |1  —  a/3\4  [  } 

From  dP/d/3  =  0  we  get  after  simple  manipulation, 

(a  +  c)*(l  +  Pc)\s\2  4-  (6  +  f3)(  1  -f  a6)*|np  =  0  (19) 


Pop  =  - 


(a  4-  c)*|sp  -(-  6(1  -f  a6)*|n  2 
c(a  4-  c)m|s  2  4-  (1  4-  a6)*|nP 


provided  1  —  a/3  0.  Thus,  if  a  =  — c,  then  pop  =  —b  and  perfect  cancellation  will 

result.  Also  from  Figure  2 


Q  =  MOP  = 


jl  4-  a6p|np  +  |c  4-  ap  s  2 

|1  -  a/?P 


Therefore,  dQ/da  =  0  implies 


(1  4-  6q)(6  4-  P)*\n\2  4-  (a  4-  c)(l  4-  /?c)*|sp  =  0 


Opp  — 


(6  4-  /7)"|nPjf  c(l  4-  /3c)’\s\2 
6(6  +  d)-H2  +  (i  +  /?c)*|Ip 


provided  1  —  a/3  0.  Again  if  6  =  —  p  aop  =  —c  and  perfect  cancellation  results. 


Comparing  (19)  and  (22),  we  notice  that  their  left  hand  side  terms  form  a  complex 
conjugate  pair.  Therefore,  they  constitute  a  degenerate  set  of  equations  which  does 
not  have  a  unique  solution  in  a  and  /?,  so  that  difficulties  are  to  be  expected  if  0^,  0^ 
are  sought  via  any  search  algorithm. 

This  difficulty  can  be  remedied  by  using  the  signals’  discrimination  networks  whose 
effect  on  the  two  signals  is  different  in  some  way  e.g.  complex  gain,  etc.  Such  a 
network  helps  distinguish  one  signal  from  the  other  by  putting  emphasis  on  either 
one.  For  example,  if  discriminator  No.l  is  such  that  its  output  power  is  Pi  given  by 

(17)  with  Si  and  nj  replacing  s  and  n,  respectively,  then  (19)  and  (20)  will  change 

accordingly.  Similarly  using  Q2  to  drive  a,  where  Qi  is  given  by  (21)  with  s2  and 
n2  replacing  s  and  n  respectively,  then  (22)  and  (23)  will  change  accordingly.  If  we 
have  at  least  Si  ^  s2,  or  ni  ^  n2  then  the  set  of  Equations  (19)  and  (22)  is  no  longer 
degenerate.  They  are  a  set  of  two  bilinear  equations  in  a  and  0.  In  fact  with  the 
effect  of  the  discriminator  (17)  and  (21)  can  be  rearranged  to  get 

(a  +  c)(l  +  /3c)*(|si|2  jn2|2/|ri1|2  -  |s2|2)  =  0  (24) 

(0  +  6)(1  +  a6)*(|n2|2H7l^  -  RF)  =  0  (25) 

If  based  on  some  slight  information  about  the  signals,  discriminators3  can  be  found 
such  that  at  their  output  we  have  |si|2  |n2|2  ^  |s2j2  |ni|2  then  the  only  two  solutions 
are  a  =  —  c  and  0  =  ~b  ov  a  —  \  and  0  =  —  £  .  The  second  pair  is  not  valid  if  we 
constrain  |aj  and  \0\  to  be  smaller  than  unity  ( b  and  c  are  assumed  to  have  magnitude 
less  than  unity).  The  unique  solution  aop  =  — c  and  0op  =  —  b  are  the  required  values 
of  a  and  0  that  renders  perfect  cancellation  at  both  outputs. (see  (17)  and  (21)) 

3Such  discriminator  has  been  shown  to  exist  for  satellite  communication  [5]  microwave  radio  [10] 
and  narrow-band  tactical  communication  [9]  application. 
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2.2.2  The  Power-Correlation  Scheme 


From  Figure  3, we  have 

vp(t)  =  vi  (t)  +  0vq(t)  (26) 

vq(t)  =  v2(t)  +  QVi{t)  (27) 

P  =  Wi)p  =  1(1  +  0[a  +  c)|W  +  \b  +  0(l  +  Qt)|2W?  (28) 

where  we  used  the  assumption  that  s(t)  and  n(t )  are  zero-mean  uncorrelated  pro¬ 
cesses.  Equating  the  derivative  of  (28)  with  respect  to  /?  to  zero  we  get 

(a  +  c)'|sp  +  /3\a  +  c|2|s|2  +  /?|1  +  o6|2|n|2  +  6(1  +  a6)‘|n|2  =  0  (29) 


and 


6(1  +  o6)’,|n|2  -f  (a  +  c)*|s|2 
|1  -f  a6|2|n  2  +  +  c|2|s|2 


Thus  if  a  =  — c  then  f3op  —  -6/(1  +  a6)  and  a  perfect  cancellation  of  the  n  signal  will 
result  (see(28)).  With  a  dose  to  -c,  we  can  assume  that  |a  +  c|2  <  |1  +  a6|2|s|2/|n|24 
and  hence 

= _ t  (o  +  c)-j7F  (31) 

1  +  ab  |l+a6|2]Sp  1  ' 

Also  from  Figure  3 

02  =  k’,(l)»;(0|J  =  |A|2  (32) 

where  as  it  can  be  easily  shown,  using  the  zero  correlation  property  of  s(t)  with  n(t ) 
that 

A  =  (a  +  c)( i  +  /i( a  +  c))*|s|2  +  (1  -t-  a6)(6  +  /?(1  -I-  a6))’|uj2  (33) 

Notice  that  in  comparison  to  the  corresponding  terms  in  (17),  (21)  or  (28)  the  terms 
in  |Aj2  do  not  depend  linearly  on  the  independent  variable  a  (see  also  Appendix  A-l) 
and  hence  the  general  rule  for  the  derivative  in  the  footnote  on  page  4  is  not  valid. 

~*Since  the  signal  propagate  through  the  same  path  one  can  take  without  loss  of  generality  that 
|sj*  and  |n|2  are  of  the  same  order. 
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However,  directly  from  (P-1)  and  (P-2)  in  Appendix  A-l,  we  have 


6Q2/daR  =  AmdA/daR  +  AdAm/daR  (34) 

dQ2/dai  ^  AmdA/dai  +  AdA'/d a:  (35) 

where  the  subscripts  R  and  /  designate  the  real  and  imaginary  paxts,  respectively. 
From  (33), 

dA/daR  =  jIF  +  2  /T  (a  +  +  W2R*  +  2  (3’(bR  +  aR|6|2)M*  (36) 

and 

dA/dat  =  4-  2 3‘(a  +  c),\s\2  +  j\b\2\n\2  +  2 +  a^b]2)'^  (37) 

It  is  clear  that  dA’/daR  =  (dA/daR)m  and  dAm/da /  =  ( dA/dai )’.  Equation  (34) 
and  (35)  become  simultaneously  equal  to  zero  if  either  one  of  the  following  conditions 
is  satisfied. 

1.  A  =  A*  =  0,  dA/daR  #  0  (dAm/daR  #  0) 
and  dA/daj  ^  0  (dA'/dai  ±  0) 

2.  dA/d  OR  =  0  and  dA/dai  =  0  4^0 

3.  Neither  of  the  terms  above  is  zero,  but  the  corresponding  sums  in  (33)  and  (34) 
are  zero. 

Under  the  first  condition  we  have  from  (33) 

(a  +  c)R*  +  d*|  a  +  c|2|7p  +  /T|l  +  ori>|2T7Tp  +  &*(  i  +  Q&)Rp  =  0  (38) 

With  a  close  to  -c  and  \tf\  <  1  we  have  +  cj2  <C  (o  -f  c)R  and  8i\a  +  c|2  < 
(q  +  c)/,  and  we  can  neglect  the  second  term  in  (38)  leaving 

ctop  =  ~c  -  ( 1+  aopb){b  +  0(1+  aop6))'|n|2/|s|2  (39) 
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Again  if  0  =  —6/(1  +  aop6),  then  aop  =  — c  and  a  perfect  cancellation  of  the  s 
signal  at  vq(t)  will  follow.  Finally  we  notice  from  the  conclusion  following  (30)  and 
(38)  that  the  condition  for  the  first  leads  to  a  result  which  is  needed  by  the  second 
equation  and  vice  verse.  Hence  if  these  two  equations  are  solved  simultaneously,  they 
lead  to  the  stated  aop  and  3op. 

As  in  the  power-power  arrangement,  Equations  (29)  and  (38)  constitute  a  de¬ 
generate  set  of  equation  which  does  not  have  a  unique  solution.  Therefore  signals’ 
discrimination  networks  are  needed  if  aop  and  0op,  the  solution  of  (29)  and  (38).  are 
sought  via  a  search  algorithm. 

Under  the  third  condition  above  (i.e.,  when  none  of  the  terms  A,  dA/dan  or 
<3 ,4/da  /  equals  zero,  but  the  corresponding  sums  of  (34)  and  (3c  ■-/  \  it  is  possible 

to  show  by  talcing  the  required  derivative  that  the  optimum  values  of  or  and  a/  are 
given  by 


cr\s\2  -1-  6R|n|2 

Real[A ] 

(40) 

QR  MP  + 1  w 

2Real[AB] 

c/|s|2  -  6/|n|2 

Im[A] 

(41) 

PF  +  IW 

2Real[AB } 

By  examining  the  nature  of  the  solution  of  the  minimization  problem,  a,  defined 
by  (40)  and  (41),  one  can  show  that  such  a  solution  can  not  exist  in  practice  if  we 
restrict  0  to  satisfy 

IfoU.  =  1 01 1  max  <  l/2N/2(]7p/i^j2)^(i/|i  +  (42) 

or  if  (using  the  stronger  condition). 

I0rU..  =  |AU«  <  l/2V5(Wml£[l/(I  +  MI&UJ  (42a) 

In  which  case  this  extremum  point  will  be  either  a  point  of  maximum  or  a  saddle 
depending  whether,  or  not,  Jr  and  Ji  are  of  the  same  order.  Particularly  if  0  is 
constrained  to  satisfy  (42),  then  this  extreme  value  of  a  will  not  be  a  minimum  point. 
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To  exhibit  numerically  the  meaning  of  this  design  constrain,  we  first  notice  using 

(30)  with  Q  ~  —c  that  \0op\  =  l^l/|l  +  a^l  —  H/0  —  !QII^I)  —  l^|max/(l  —  Minima*)- 
Therefore  for  any  possible  f30p  to  be  within  the  value  of  (42a)  it  is  sufficient  to  require 

that 

|6U«/(1  -  |a||4U«)  <  1/2^(PF/WT)^I1/(1  +  («i>) 

Assuming  (FF/R^mm  ^  1  then  for  |a|  ~  c|  ~  b\max,  (41b)  is  satisfied  if  |6|mar  < 
0.295.  Let  the  de- polarization  coefficients  |6|  and  |c|  be  at  most  0.295  (~  10rf6),  then 
the  upper  bound  on  (3r  and  (3{  given  by  (42a)  equals  0.326. 

Notice  that  for  a  wider  useful  range  of  /?,  (N7W2)m,„  should  be  largest.  If, 
for  example,  the  expected  (j7p/(nP)mi„  is  less  than  the  expected  (|n|2/|s|2)  then  it 
is  preferable  to  change  the  role  of  the  two  signals  in  the  system  by  exchanging  the 
power  processor  with  the  correlation  processor  and  vise  versa. 

Under  the  second  condition  for  making  (34)  and  (35)  equal  to  zero  (namely  when 
dA/datR 

-  o  and  dA/dai  =  0  but  A  ±  0)  we  notice  that  (37)  can  not  be  made  to  equal  zero 
unless  0  is  real.  Similarly,  (37)  can  not  be  made  to  equal  zero  unless  0  is  purely 
imaginary.  In  these  particular  cases 


_1 _ cr|s|2  +  bft|n|2 

2  0r  jTj2  +  jftpM2 


)3  real 


(43) 


1  c/js|2  -  bR\n\* 
|s|2  +  i&|2|n|2 


0  purely  imaginary 


(44) 


respectively.  It  is  shown  in  Appendix  A-2  that  these  values  of  qr  and  q/  are  points  of 
maximum  for  Q2.  Furthermore  they  will  not  occur  in  practice  since  \0\  is  constrained 
to  be  small  just  as  |aj. 

In  conclusion,  we  observe  that  in  the  power-correlation  scheme  the  optimal  weight 
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(flop)  for  the  power  processor  must  satisfy  (30),  while  a ^  for  the  correlation  processor 
can  be  obtained  solely  by  (30)  provided  certain  design  conditions  and  constraints  are 
met.  These  conditions,  can  easily  be  met  in  practical  cross  polarization  problems. 

2.2.3  The  Correlation-Correlation  Scheme 

From  Figure  4  it  is  quite  obvious  that  without  the  signals’  discrimination  networks, 
the  control  loops  are  indistinguishable.  Notice  that 


vp(t)  =  Vi{t)  +  0v2(t)  (45) 

v,(t)  =  avi(t)  +  v2(t)  (46) 

and  by  using  (1)  we  get 

Pi  =  |M<K(0|2  =  l^il2  (47) 

where 

Ax  =(6  +  /9)(l  +  6a)*(6nl)2|^P  +  (c  +  a)*(l  +  c^1)W  (47a) 

and,  6„i  =  ni/n  and  6,i  =  si/s,  represent  the  effect  of  the  discriminator  networks.5 
Similarly 

Q2  =  IMOMOI2  =  \A2\2  (48) 

where 

A2  =  (6  +  /?)*(!  +  6a)(<5n2)2M2  +  (c  +  o)(l  +  c/d)*(6j2)2|s|2  (48a) 


and,  Sn2  =  n2/n  and  6s2  =  s2/s.  In  the  derivation  of  (47a)  and  (48a)  we  used  the 
zero  correlation  property  of  s(f)  and  n(t).  To  derive  the  optimal  weights,  aov  and 
Pop  we  follow  the  same  steps  used  in  obtaining  aop  of  the  correlation  processor  in  the 

5  For  simplicity  the  effect  of  discriminator  was  assumed  to  cause  different  real  gain  for  the  different 
signals. 
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previous  scheme.  That  is,  to  find  3^  of  the  correlation-correlation  scheme,  we  must 
equate  dPi/d^i  =  0  and  dPifd^R  =  0  simultaneously  to  zero.  In  Appendix  A-3  we 
prove  that  dPi/dfln,  =  0  and  dP\jd(3i  =  0  if  and  only  if  Ax  =  0.  This  implies,  using 
(47a), 

6  =  b(l  +  ban6nl)iW  +  (c  +  aY(6al)>W  ,  , 

(l  +  ia)-(<5nl)2|n|2  +  C(c  +  omi)2|s|2  (  ' 

Notice  that  if  a  =  — c  then  3 op  =  —b  and  we  get  a  perfect  cancellation  of  the  n  signal 
at  vp(t).  We  can  use  a  similar  argument  to  find  aop  from  equating,  simultaneously, 
dQ2/dotR  and  dQi/dai  to  zero,  namely 


c(l  +  c5)-(6j2)2|s|2  +  (6  +  0Y(6n,y\n^ 
(1  +  c^)*(^2)2|s|2  +  b(b  +  /?)*(M2M2 


Again  if  3  =  —b  then  aop  =  -c  and  we  get  a  perfect  cancellation  of  the  s  signal 
at  vq(t).  Equations  (49)and  (50)  are  the  same  as  (20)  and  (23),  respectively,  which 
represent  the  optimal  weights  for  the  power-power  scheme.  Recall  that  the  latter 
were  obtained  with  the  rather  reasonable  condition  that  |1  —  a0\  ^  0. 

To  conclude  this  section,  we  introduce  in  Table  1  a  summary  of  the  equations  rep¬ 
resenting  the  optimal  weights  of  the  three  configurations  together  with  the  conditions 
under  which  these  weights  are  attainable. 


2.3  The  Optimal  Output  Signals’  Power  and  Power  Ratios 

Using  the  optimal  weights  derived  in  the  previous  section,  we  now  find  the  optimal 
powers  of  the  two  signals  at  the  two  different  output  ports.  This  we  do  for  the  different 
cross-pol  cancelers  schemes  by  implementing  the  corresponding  optimal  weights. 
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2.3.1  The  Power-Power  Scheme 


From  (20)  we  get 


1  +  c/3  = 


(1  +  a6)*(l  -  d>)lni[2/|si[2 


and 


b+l 3  = 


c(a  +  c)m  +  (1+  a6)*|ni|2/|si|2 

( a  +  c)*(  1  —  cb) 
c(a  +  c)*  +  (1  +  a6)*jn1|2/|s1|2 


(51) 


(52) 


We  also  introduce  in  (51)  and  (52)  the  effect  of  the  discriminator  network  Xo.l  (see 
Figure  2).  From  (17)  we  get,  by  using  (51),  the  s  signal's  power 

1 


Pa  = 


|1  —  q3  I2 


(1  +  q6)*(1  -  c6)|ni|2/|6i|2 


c(q  +  c)m  +  (1  +  Q6)‘|n1|2/|s1|2 


|5|2 


and  by  using  (52),  the  n  signal's  power 


(53) 


Pn  = 


1 


|1  -o/3|2 


(q  -I-  c)*(l  -  cb) 


c(q  +  c)m  +  (1  +  ai)*jn1|2/|5ij2 


n 


(54) 


The  signals’  power  ratio  at  this  port  is  given  by 

P./Pn  =  1^2*  «.,/«.l)JISF/lJP  (55) 

Q  +  C 

where  =  n\/n  and  S3 1  =  s\/s.  From  (55)  we  notice  that  the  power-inversion 
relation  has  been  enhanced,  as  a  result  of  the  bootstrapping  arrangement,  by  the 
factor  |(1  4-  ab)/(a  +  c)|2,  which  approaches  infinity  (perfect  cancellation)  if  a  =  — c. 
Further  enhancement  of  the  s-to-n  signals'  power  ratio  prevails  if  the  discriminator 
network  is  chosen  such  that  6,i  <  <5„i.  With  the  smallness  condition  assumed  for  \b] 
and  |c|  and  the  constraint  imposed  on  |a|.  we  can  easily  show  that  the  input-output 
transmission  for  the  s  signal  is  approximately  unity 

PJW  a  1  (56) 
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provided  that  |a  +  c|  is  very  small  so  that  |/3  +  b\  is  approximately  equal  to  zero. 
Similarly  the  input-output  cancellation  factor  is 


Pn/|nP~|a  +  c|2/(|m|Vhl2)2 

Notice  the  improvement  in  cancellation  if  6*1  <  Sni. 
Similar  argument  leads,  for  the  second  part,  to 


(57) 


Qn/Qs  = 


1  +  /?c 


0  +  b 


(WM’NVW2 


(58) 


as  the  n-signal  to  s-signal  ratio.  Also  the  input-output  transmission  for  the  n-signal 


QJ\n\>  as  1 


(59) 


provided  \0  +  b\  is  very  small  so  that  jo  +  c\  is  approximately  zero.  The  input-output 
cancellation  factor  of  the  s-signal, 


Qa/\s\2  —  |/3  +  ^r/(|s*|2/|n2|2) 


2\2 


(60) 


2.3.2  The  Power-Correlation  Scheme 


Using  the  value  of  /30p  (Equation  30)  we  obtain  from  (28)  the  optimal  output 
powers  at  the  P  port.  The  s-signal  optimal  power, 

.2 _ 

|s|2 


P,= 


(i+o*r(i-4c)i»«ivi«ii2 


|a  +  cP  +  |l  +  a6|2|n1p/|5,|2| 
where  we  also  introduce  the  effect  of  the  discriminator  network  on  (30) 
The  other  signal  optimal  power. 


(61) 


(a  -|-  c)*(l  —  cb) 


|o  +  cP  +  |l+o6P|n,P/|s,P 

The  signals’  power  ratio  becomes 


(62) 


Ps/Pn  = 


1  4-  a6 


Q  +  C 


(^nl/<^*l)2(np/|s12 


(63) 
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Furthermore,  with  the  smallness  condition  assumed  for  the  system  inputs  and 
parameters,  |a  +  c|2  <  |1  +a&|2|ni|2/|si|2,  we  have  for  the  input-output  transmission 
of  the  s-signal, 


Ps/\S  |2 


1  —  be 


1  +  ab 


~  1 


(64) 


and  the  input-output  cancellation  factor  of  the  n-signal  is 


Pn/M2  ~ 


(a  -f  c)*(l  —  cb) 


|1  -f  a&|2 


/(|n,|a/l- 1!2) 


2\2 


~  lo  +  clVdn.IVk.l2)2 


(65) 


The  approximations  made  in  (64)  and  (65)  tire  true  if  we  further  assume,  |c|  =  |6|  <C  1. 

At  the  Q  port  of  the  correlator  processor,  the  output  power  is  obtained  by  sub¬ 
stituting  the  optimal  weight  aop  from  (39)  we  get  for  signals’  power  ratio 

|2 


Qn/Qs 


1 


|  b  -f-  3(  1  -f-  otopb ) 
and  for  the  input-output  transmission  of  the  n-signal; 


(WM2N2/W2 


(66) 


Qn/|n|2  =  |1  -  bc\2  -  1 


(67) 


provided  |6j  =  |c|  1.  The  cancellation  factor  of  the  s-signal  is 

Q,/W  =  \b  +  0(1  +  q0J,6)|2/(RP/|^F)2  (68) 

Notice  that  the  output  power  ratio  Ps/Pn  (63)  is  the  same  as  that  obtained  with  the 
power-power  scheme  (55).  Comparing  the  other  port  power  ratio  Qn/Q»  (Equations 
(58)and  (66)),  we  notice  a  slight  difference  which  is  a  direct  consequence  of  the  fact 
that  (39)  is  a  second  order  equation  in  a,  and  that  the  steady  state  optimal  weight 
of  the  3  processor  for  the  power-correlation  scheme  is  not  exactly  the  same  as  that  of 
the  0  processor  for  the  power-power  scheme  (compare  (20)  with  (30)).  Similar  results 
are  obtained  when  comparing  the  input-output  transmission  for  one  signal  of  the 
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input-output  cancellation  factor  to  the  other  signal  (see  (56),  (57),  (59)  and  (60)  to 
the  power-power  scheme  and  (64),  (65),  (67),  (75)  to  the  power-correlation  scheme). 
Notice,  particularly,  the  slight  difference  that  resulted  from  having  b  +  0(1  +  Qopb) 
(in  (68))  for  the  power- correlation  instead  of  b  -I-  0  (in  (60))  for  the  power-power. 
However,  both  terms  were  found  to  reach  an  ideal  zero  value  if  the  corresponding  a 
processor  approaches  its  ideal  optimal  value.  Small  differences  might  occur,  however, 
because  the  different  scheme’s  structure  can  result  in  different  final  ideal  values  of 
these  terms. 

2.3.3  The  Correlation-Correlation  Scheme 

From  Figure  4,  we  find  the  output  power, 

f=Wf)F=|i+/3|2R+|l+^lW  (69) 

Except  for  the  (1  —  a/?|2  factor,  this  is  exactly  the  same  as  Equation  (12)  which 
represents  the  output  power  at  the  P-port  of  the  power-power  scheme.  We  have  also 
shown  in  Section  (2.3)  that  the  optimal  weights  for  the  correlation-correlation  scheme 
are  the  same  as  those  for  the  power-power.  Therefore,  we  expect  to  have  the  same 
terms  (except  for  the  division  by  (1  —a/?)2)  for  the  s-signal  output  power  P,  (Equation 
53),  the  n-signal  output  power  P„  (Equation  54)  and  s  —  to  —  n  power  ratio  P,/Pn 
(Equation  55)  at  the  P  port  and  similarly  for  Qn.Qs  and  Qn/Qs  at  the  Q  port.  The 
same  applies  for  the  input-output  transmissions  and  cancellation  factors  (Equations 
(56),  (57),  (59)  and  (60)). 

In  Table  2,  we  summarize  the  equations  representing  the  s-signal  and  n-signal 
optimal  output  powers  at  the  P  and  Q  port  of  the  three  different  configurations.  In 
Table  3,  we  summarize  the  equations  representing  the  power  ratios  PsjPn  and  Qt/Qn 
at  the  two  ports,  respectively.  Also  represented  in  Table  3  are  the  input-output 
transmission  ratios  and  cancellation  factors  for  the  different  configurations  and  the 
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separate  ports. 


3  Conclusion  and  Further  Work 

After  demonstrating  the  fact  that  the  simple  “noise  cancelling  scheme”  proposed 
by  Widrow  [1]  cannot  be  used  in  the  cross  polarization  problem,  the  bootstrapping 
approach  was  proposed.  Three  different  optimization  criterian,  namely  power-power, 
power-correlation  and  correlation-correlation  criterian  were  considered.  Correspond¬ 
ingly,  three  bootstrapping  configurations  were  examined.  For  each,  the  optimal  com¬ 
plex  weights  were  found  together  with  the  conditions  under  which  these  optimal 
weights  are  the  unique  solutions  for  the  optimization  problem  and  hence  will  be  at¬ 
tainable  if  an  adaptive  algorithm  (such  as  the  steepest  decent)  is  used.  Consequently, 
equations  for  the  optimal  signal  power  outputs  and  signal-to-interference  power  ratios 
at  the  two  different  output  ports  were  derived.  The  input-output  signal  transmission 
and  cancellation  factors  were  calculated.  It  was  shown  that  any  of  the  bootstrapping 
arrangements  achieves  a  power  separation  (high  signal-to-interference  ratio  at  both 
output  ports).  However,  for  a  power  separation  a  discriminator  technique  (which  de¬ 
pends  on  the  signals'  properties  and  can  take  the  form  of  a  filter,  limiter,  etc.)  must 
be  used.  The  need  for  such  discrimination  networks  was  explained  and  their  effect  on 
obtaining  unique  steady  state  solutions  was  exhibited. 

To  conclude,  we  make  the  following  remark  in  relation  to  performance  compari¬ 
son  of  the  three  bootstrapping  configurations  considered  in  this  appendix:  while  the 
symmetric  power-power  and  correlation-correlation  schemes  produce  the  same  out¬ 
put  signal  powers  and  power  ratios,  the  asymmetric  power-correlation  scheme  has  a 
slightly  different  signal  power  and  power  ratio  at  its  Q  port.  These  differences  are 
only  of  a  second  order  and  might  exist  only  if,  due  to  some  system  or  input  impu¬ 
rities  (Gaussian  noise,  quantization  error,  etc.),  the  ideal  optimal  conditions  are  not 
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reached.  The  same  conclusion  is  in  effect  when  comparing  the  input-output  trans¬ 
mission  or  cancellation  factors. 

Examination  of  Figures  2  through  4  reveals  the  fact  that  the  three  configura¬ 
tions  proposed  require  different  levels  of  hardware  complexity;  some  need  correla¬ 
tors  (harder  to  implement)  others  require  power  measurements.  The  correlation- 
correlation  scheme  is  expected  to  be  the  most  complex  while  the  power-power  scheme 
the  least.  Also  different  signal  paths  (through  the  system’s  circuitry)  are  expected  to 
result  in  different  system  delays  with  the  different  configurations  and  hence,  different 
bandwidth  limitations.  The  question  of  a  possible  trade-off  between  complexity  and 
bandwidth  is  raised.  This  will  be  addressed  in  a  subsequent  appendix. 

Gaussian  noise  effects  on  the  system  performance  and  the  analytical  results  of  this 
appendix  should  also  be  considered.  In  particular  it  is  important  to  investigate  the 
limit  on  cancellation  depth  and  hence  on  the  quality  of  power  separation  that  this 
noise  might  cause. 

The  above  items  are  questions  which  are  obviously  related  to  the  subject  of  this 
appendix,  namely  steady  state  analysis,  but  they  will  be  reported  separately  in  ap¬ 
pendix  B. 

Finally,  the  whole  subject  of  dynamic  analysis  must  be  investigated  for  the  three 
configurations. 
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IV.  APPENDICES 


A-l 


For  any  function  of  a  complex  variable  f(0)  we  have, 

Eimrm  =  evup)  +  fim  =  Euim + E[f?m 

where  R  and  I  designate  the  real  and  imaginary  parts,  respectively.  Since  the 
two  components  of  /(/?)  are  in  quadrature  relation  to  each  other,  they  can  not  be 
minimized  independently. 

wREW)rw]  =  +  *i  <n 

~E[fwrm  =  E\mdJ^\ + (2) 

Accordingly,  we  define, 

j-aE\mrm  =  ^ mwm + w 

if  /(/?)  is  linear  in  0 


f{0)  —  +  a.20 


then 


ddR 


E[/mrm  =  ew)*%  + 


and 


Jj£[/(/3)/-(3)]  =  £[-j/(j3)a;]  +  £[>/*(/»M 


Using  (P-3)  we  get 


j^£(/(  J)/-(^)l  =  2  E\a\m\ 
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This  is  the  l^gular  complex  algorithm  of  Widrow  [11].  This  is  also  what  we  termed 
the  general  rule  for  a  complex  derivative. 

Notice  that  we  can  write  in  an  “informal  lorm” 


(4) 


This  is  an  informal  since  df((3)/d3  has  not  yet  been  defined.  If  f(/3)  is  a  general 
function  of  3  then  we  must  use  (P-1),  (P-2)  together  with  (P-3)  to  obtain. 


djimrm 

d(3 


=  E[/m 


arm  ,  -dr(fi) 


dpR 


+  ;■ 


dpi 


03j 


from  which  (P-4)  results  if  we  define  ‘'informal”  that  for  any  function  f{3) 


dm_  =  d_m  dm 

d3  dpR  d3i 

Notice  that  df (3)/d3  is  not  a  complex  conjugate  of  the  function  df‘(3)/d3.  Also 
for  f(3)  linear  in  3  =  0 


A-2 

To  check  the  nature  of  the  extremum  points  defined  in  (43),  for  3  real,  one  can 
show  from  (48)  and  (48a)  that 

d2Q2/da2R  =  2  Real[A2d2A’2/da2R)  (5) 

and 

d2A2/daR  =  2  3(W  +  |6|  W) 

Hence 


d2Q2jda2R 


=  4/?ea/[Ai9](|s|2  +  |6|2|;t|2) 


(P-6) 

Using  (43),  (P-6)  yields, 

aJQ2/s4  =  4(1JF+.«W) 

D93U1«  -  *11+  ^PN7)  -  \(W  +  IH’R)]  (7) 

With  the  smallness  condition  assumed  for  b  and  c  and  the  constraint  imposed 
on  a  and  /?,  d2Q2/da2R  <  0  and  the  point  defined  by  (43)  is  a  point  of  maximum. 
Similar  steps  can  be  used  to  show  that  d2Q/d2  <  0  and  the  point  defined  by  (44) 
with  3  =  j Pi  (pure  imaginary)  is  a  point  of  maximum. 

A-3 

Directly  from  (P-1)  and  (P-2  and  similar  to  (36)  and  (37),  we  have  dPi/dfin  = 
2  Real 

[AldAi/dfiFi]  and  dPi/dfri  =  2Rtai[A\dA\/d3i].  From  (47a)  we  get 

dAi/d3fi  =  (1  -  0Qi*(6n,)2|n)2  +  c(c  +  q)‘(6,i)2|s|2  (8) 

8A\jd3i  =  j(  1  +  MV-.,rin|2  +>c(c  +  ar)*(6,1)2|s|2  -jdAi/d3fl  (9) 
Using  (P-9)  we  also  have 

Rtal[A jd.-ii  /  33/]  =  —  I m\A\d A\ I d 0 pi\  (16) 

Therefore  dPx/d8fi  =  0  and  dP\  33i  =0.  simultaneously,  if  and  only  if 

]A:dAx/d3R]  =0  (11) 
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Notice  that  9Ai/df3R(dA\/d3i)  is  independent  of  3r(0i),  therefore  .4i  is  indepen¬ 
dent  of  /3  if  dAild^R  =  0(dAifd3j  =  0).  But  for  9Ai/9(3r  =  0  we  must  have 

C-(^,|S|»  +  6(<nl)’|n|’ 

which  will  not  occur  in  practice  if  we  assume  |c|  and  |6|  are  much  smaller  than  unity 
and  restrict  |a|  to  be  less  than  unity.  Therefore,  9Ai/93r  or  9Ai/9@i  =  0  and  Ax  ^  0 
do  not  constitute  an  extremum  point,  so  that  the  only  point  of  extremum  for  is 
that  which  is  obtained  by  equating  .4j  to  zero. 
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condition 


Table.  1 
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Table  I.  Summary  of  equations  representing  the  optimal  weight  of  the  three  configuration  and  conditions 
under  which  these  optimal  weights  are  attainable.  *,  =  sSua2  =  s6.3,  =  n«ni,  and  n3  a*  nSni\ 

where  6„  and  6n  represent  the  effect  of  the  discriminitor  networks. 


8-signal  n-signal 
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The  Power- 
Power  Scheme 


The  Power- 
Correlation  Scheme 


The  Correlation- 
Correlation  Scheme 


P | tort 

P./Pn 

|“f  )W/W 

The  same  as  in  the  power- 
power  scheme 

a 

~  1 

Pn/|n|2 

|a  +  c|2/(Kp/N^)2 

Q  port 

Qn/Q. 

~  1 

|1  -  6c|2  ~  1 

1  /i  +  i|JM/W2 

Ift  +  ^l  +  a^lVd^P/W)2 

Table  3.  Summary  of  equations  representing  the  signals’  power  ratios  ( P»/Pn,Qn/Qi )» 
the  input-output  transmissions  (P*/|s|2,(Jn/|n|2)  and  the  cancellation  factors 
(P„/|n|2,Q,/|s|2)  for  the  different  configurations. 


Table.  3 
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Fig.  2  Power- Power  bootstrapped  canceler 


Fig.  3  Power-Correlation  bootstrapped  canceler 
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Fig.  4  Correlation-Cororrelation  bootstrapped  canceler 
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Appendix  B 


Bootstrapped  Adaptive  Separation  of  Superimposed  Signals  -  Effect  of 

Thermal  Noise  on  Performance 

V.  Bar-Ness,  A.  Ding  and  H.  Messer 

Abstract 

Bootstrapped  adaptive  signal  separation  techniques  were  shown  to  be  powerful 
tools  for  separation  of  superimposed  signals  with  an  unknown  parametric  model. 
Estimation  of  all  unknown  model  parameters  are  done  simultaneously,  using  the  es¬ 
timated,  separated  signals  under  certain  optimization  criteria.  When  the  signals  to 
be  separated  are  uncorrelated,  random  processes  the  algorithm  converges  to  the  un¬ 
known  model  parameters  and  the  outputs  are  a  clean  version  of  the  input  signals, 
provided  that  no  additive  noise  is  present.  In  this  appendix,  we  analyze  the  effect  of 
additive  thermal  noise  on  the  performance  of  the  various  structures  of  a  bootstrapped 
signal  separator.  We  show  that  this  noise  introduces  bias  to  the  model  parameter  es¬ 
timates.  We  study  this  bias  and  we  derive  conditions  under  which  its  effect  is  limited. 
We  provide  a  practical  example  where  the  separation  of  the  input  signals  is  hardly 
degraded  due  to  the  presence  of  additive  thermal  noise. 
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1  Introduction 


Separation  of  superimposed  signals  is  a  major  problem  in  many  different  fields. 
In  fact,  many  problems  are  strongly  related  to  the  separation  problem.  For  ex¬ 
ample,  if  a  desired  signal  and  an  interference  are  considered  as  two  signals  to  be 
separated,  the  well-known  interference  cancellation  problem  can  be  regarded  as  a  sig¬ 
nals’  separation  problem.  In  an  interference  cancellation  application,  however,  one 
is  usually  not  interested  in  the  interference  signal  while  in  other  applications  all  the 
signals  to  be  separated  are  of  interest.  The  general  formulation  of  the  problem  is: 
given  x(t)  —  T(s(t),fl)  f  n (t).  design  a  separation  system  G  having  the  input 
x(f)  and  the  output  y(t )  =  s (t):  an  estimate  of  s(t)  .  s(t)  =  [si(f), ...,  syv(f)]r  is  an 
N  dimensional  signal  vector.  T(0)  is  the  mixing  transformation  which  depends  on 
the  model  parameter  vector  0.  x(t)  =  [xj(f), ...,  XA/(f)]T  is  the  M  dimensional  vector 
of  the  resulting  superimposed  signals,  with 


N 

xm(t)  =  ][]rmn(s(t),0)  +  nm(t),  m  =  1,2,  ..M  (1) 

n=l 

Also,  G  is  the  separation  system  and  y(t )  is  the  N  dimensional  vector  of  the  separated 
signals.  n(t)  =  ...,njvf(f)]T  is  an  M  dimensional  vector  of  the  additive  noise 

(see  Fig.  1).  If  the  mixture  model  is  linear  in  s(t)  then 


T(0)  = 


Tn(0)  •••  T1N(6) 

T„(9)  . 

Tm(8)  •••  Tm„(6)  J 


(2) 


In  which  case,  it  may  take  the  form  of  a  constant  matrix,  T(0)  =  T,  or  a  linear 
time  invariant  multi-input  multi-output  (MIMO)  system;  T(t,6)  =  F~l {H{w.O)} 
where  H(w,&)  is  an  MxN  transfer  function  matrix,  or  any  non-linear  operation  which 
depends  on  a  parameter  vector  9. 

If  9  is  known,  then  the  problem  is  that  of  a  multidimensional  filtering.  If  the  trans¬ 
formation  is  linear,  its  solution  is  well  known.  If  T(0 )  is  a  non-linear  transformation, 


'2 


the  solution  of  the  non-lineax  filtering  problem  depends  on  the  type  of  non-linearity, 
but  it  can  usually  be  found. 

In  practice,  however,  6  is  rarely  known.  Thus,  the  separation  problem  is,  in¬ 
herently,  a  non-linear  multidimensional  filtering  problem  and  is  a  very  complicated 
one.  Inspired  by  Widrow's  adaptive  LMS  algorithm  [l],  Bar-Ness  and  Rockah  [2] 
first  suggested  (for  the  two-inputs  two-output  case)  to  use  each  of  the  outputs  of 
the  separator  as  a  refeience  input  of  an  LMS  algorithm  which  produces  the  other 
output.  Since  this  arrangement  successively  improved  the  purity  of  the  reference  in¬ 
puts  and  hence  the  corresponding  outputs.  Bar-Ness  called  his  idea  “a  bootstrapped 
algorithm.”  The  bootstrapped  separator  idea  was  extended  to  three  different  struc¬ 
tures  termed  “power-power”,  “correlator- correlator"  and  “power- correlator”  [3]  and 
the  results  were  reported  in  the  open  literature  eg.  [4-5].  The  names  of  the  different 
structures  were  chosen  according  to  the  performance  indices  which  were  used  in  each 
of  these  structures'  optimal  criteria.  Application  of  the  bootstrapped  separators  to 
satellite  communication,  microwave  radio  and  tactical  communication  were  reported 
in  [4],  [6]  and  [7],  respectively.  Independently,  during  the  mid-eighties,  a  group  of 
European  researchers  addressed  the  same  separation  problem  and,  under  the  name 
of  “blind  signal  separation."  developed  a  similar  adaptive  system  [8].  Lately,  a  third 
group  of  signal  processing  researchers  applied  similar  ideas  to  speech  signal  separation 

[91- 

In  this  appendix,  we  review  the  three  basic  bootstrapped  algorithm  configurations 
of  the  separation  schemes  and  relate  them  to  the  "  blind  separation  ’  and  “  multi¬ 
channel  separation  ”  schemes.  We  then  analyze  the  steady-state  performance  of  the 
different  versions  of  the  algorithms  in  the  presence  of  an  additive  thermal  noise.  From 
the  study  of  the  very  general  case,  we  then  move  to  a  specific  application  -  separation 
of  cross  polarized  signals  in  satellite  communication  where  we  study  the  effect  of  the 
thermal  noise  on  the  separation  performance  in  terms  of  the  output  desired-signal  to 
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overall  noise  ratio. 


For  simplicity,  our  analysis  is  carried  out  for  the  case  where  M=N=2  (two  complex 
signals  to  be  separated,  two  complex  measurements)  and  the  mixture  model  is  a  con¬ 
stant,  complex  matrix.  Notice,  however,  the  same  analysis  principles  are  applicable 
to  any  ( M  >  N  >  2)  and  other  mixture  models. 

That  is,  our  model  is 

x(t)  =  As  (t)  +  n  (t)  (3) 

where  s (t)  =  [si(i)  52(^)]T ,  n(t)  =  [nt(<)  7i2(0]T>  A  =  *  0l  ,  is  the 
unknown  complex  matrix  mixture  model.  (Notice  that  the  assumption  that  an  = 
aii  =  1  is  not  limiting  in  any  way  since  the  signals’  power  is  assumed  unknown).  Thus 
x(t)  =  [ii(0  i2(t)]T  is  complex,  random  vector.  Given  the  vector  x(t),  separation  is 
performed  using  a  2x2  complex  matrix  W;  that  is 

y(0  =  w  x(t)  =  s(t)  (4) 

In  section  II,  we  discuss  three  different  structures  for  implementing  W:  a  back¬ 
ward/backward  (BB)  structure,  a  forward/forward  (FF)  structure  and  a  forward /backward 
(FB)  structure.  For  each  structure,  we  propose  different  optimization  criteria  to  be 
used  for  finding  W  that  leads  to  separation,  and  we  summarize  the  different  algo¬ 
rithms  which  controls  W.  Then,  in  section  III,  we  analyze  the  steady  state  perfor¬ 
mance  of  the  proposed  algorithms  in  the  presence  of  thermal  additive  noise.  In  section 
IV,  we  apply  the  results  to  the  problem  of  cross  polarization  interference  cancella¬ 
tion  and  show  that  in  a  practical  situation,  the  effect  of  the  noise  on  the  separation 
performance  is  not  dramatic. 
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2  Bootstrapped  Signals  Separator  Configurations 
2.1  The  Backward-Backward  Structure 

In  Fig.  2. a,  cross-coupled  feedback  structure  is  depicted,  w i  and  w 2  are  com¬ 
plex  weights.  The  input-output  relation  of  the  backward-  backward  configuration  is 
summarized  by 


y(t)  =  Wbbx(t)  (5; 

where 


Wfci 


_ 1_  _ 

1  —  W\W2 


1  —W\ 

—  W2  1 


By  substituting  (3)  in  (5)  we  get 


y(t)  =  WbbAs (t)  +  Wbbn(t)  ~  Hbbs (t)  +  n bb(t) 


(6) 


where. 


Hi6 


1 

1  —  W\W2 


1  —  W\C2 
02  —  W2 


a i  -  w\ 

1  —  lt’20i 
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and  nbb{t)  =  WjAn(/) .  Since  signal  separation  is  desired,  and  w2  should  be  chosen 
such  that  H»,fc  is  a  diagonal  matrix.  Here,  the  desired  solution  is 


wi  =  ai,  w2  =  a2,  (9) 

for  which  Hj,t  =1  (the  identity  matrix)  and  y(t)  =  s(f)  +  A-1n(t)  is  a  noisy  estimate 
of  the  signal  vector  (without  noise  y(t)  =  s(*)).  Notice  that  (9)  is  a  necessary  and 
sufficient  condition  for  Wbb  =  A-1,  so  the  weights  can  be  regarded  as  estimates  of  a\ 
and  a2.  If  Wbb  ^  A-1,  the  output  correlation  matrix  is  given  by 

=  E(y(<)yH(*))  =  hmr,h«  +  w»R.wg  (io> 
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where  R,  =  E{s{t)sH{t)}  and  R„  =  £{n(f)nH(0}  arethesignai  and  the  noise  covari¬ 
ance  matrices,  respectively,  and  the  noise  and  signal  vectors  are  assumed  uncorrelated, 
H  stan^s  for  Hermitian.  We  assume  that 


R„  =  cr2 1,  R,  = 


(11) 


That  is,  the  noise  processes  nj(f)  and  n2{t)  are  uncorrelated  processes  with  power 
cr2  and  the  signals  to  be  separated;  sx(t)  and  s2(t).  are  assumed  uncorrelated,  with 
power  <t2  and  a\.  respectively.  By  substituting  (11).  (8)  and  (6)  in  (1°),  we  get 


1,(12) 

where 

ru  =  a*|l  -  u'|fl2r’ *  a;|ci  ~  “ill2 

r  12  =  cr2(a2  -  u-2)*(l  -  U’ia2)  +  <7-2(ai  "  u'i)(l  ~  u’2ai)’ 

r2\  —  <72(a2  ~  u’2 )( 1  ~  a2 )  +  <72(°i  —  u’i  )  (1  —  w2a.\ )  =  r12 

r22  =  cr2|a2  -  U’2|2  +  <72|1  -  u;2ai|2  (13) 

The  diagonal  entries  of  Rhb  are  the  output  power.  £{|j/i(0|2}  and  £{|y2(0l2}» 

-espectivelv  while  the  off-diagonal  terms  are  ti.e  correlation  between  the  two  outputs, 
E{y\{t)y2{t)}  and  £{yl(t)y2(<)}  ■  In  l3]  it  was  shown  that,  for  c"  -  0  (no  thermal 
noise),  the  two  outputs  powers  are  minimal  if  and  only  if  (9)  is  satisfied.  Thus,  simul¬ 
taneous  minimization  of  both  output  powers  has  been  proposed  as  an  optimization 
criterion,  and  the  corresponding  configuration  was  referred  to  as  the  upower-power 
configuration.”  Notice,  however  that,  equating  the  derivative  of  the  output  power  to 
zero  is  a  necessary  condition  for  minimization.  That  is 

=  Ei-£-U,W  -  my2(l)\‘) 

=  £(- 2»;(1)I*1<<)  -  w,y2[t)\)  =  -2£{y, (()»;(()}  =  0  ('4> 


( 

Cjl  rj2 

.  2 

1  -  IuhI2 

“K 

+  u>i) 

r2)  r22 

+  0 

-(  il-2  +  in,*) 

1  + 

|u»2|2 
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and  similarly 


^£{|j/2(*)|2}  =  -‘lE{y\{t)y2{t)}  =  0  (15) 

where  we  used,  from  Fig.  2. a,  the  fact  that,  yx(t)  =  Xi(f)  —  wiy2(t);  y2(t)  =  x.2 {t)  — 
w2yi(t).  Although  £'{|yi(t)|2}  is  not  an  analytical  function,  the  derivatives  in  (14) 
and  (15)  are  informally  defined  as  follows  [1]:  if  A  =  \d  +  ex\2  and  i  is  a  complex 
variable  then  =  2e*(d  +  ex). 

From  (14)  and  (15),  we  conclude  that  for  minimum  output  powers,  it  is  necessary 
to  have  minimum  cross  correlation  between  the  outputs6.  Thus,  as  optimization 
critera  for  the  backward-backward  (BB)  configuration  one  can  either  use  minimum 
output  powers  or  de-correlation  of  the  outputs.  It  can  easily  be  shown  that  (14)  leads 
to 

o\ {a2  -  w2oy(  1  -  n'i0a2)  +  -  u'i0)(l  -  w2oa.\ )*  =  0  (16) 

while  (15)  leads  to  the  complex  conjugate  of  (16).  Therefore,  to  find  the  optimal 
weights  Wio  and  w2o  we  must  either  perform  minimum  power  or  de- correlation  cri¬ 
terion  by  simultaneously  solving  the  two  dependent  equations  (14  )  and  (15).  To 
overcome  the  dependent  equation  problem,  it  was  suggested  in  [2-3]  and  all  the  suc¬ 
ceeding  articles  dealing  with  bootstrapped  separators  to  add  what  wa s  termed  a 
“discriminator.”  This  is  a  certain  functional  operation  performed  on  the  outputs  of 
the  separator  and  helps  break  the  inherent  dependency  of  the  simultaneous  equation 
to  be  solved.  To  choose  an  adequate  discriminator,  some  designer  ingenuity  and  prior 
knowledge  of  “some”  differences  between  the  signals  to  be  separated  is  required.  Ex¬ 
amples  of  the  particular  discriminator,  suitable  for  different  application,  were  given 
in  [4],  [6]  and  [7],  In  [3],  it  was  suggested  to  present  the  effect  of  the  discriminator  as 
follows:  For  the  signal  Si(f)  and  sift),  the  two  discriminator  outputs  are  given  by 

D\  (si(l)  -r  -s2(t))  ~  Si(/)  +  ^i2s2(0 


6it  is  also  a  sufficient  condition  since  the  power  is  quadratic  function  of  the  weight. 


D2(Sx(t)  -f  62(0)  —  ^21sl(0  +  52 (t) 


(IT) 


where  (612!  <  1,  |^2i|  <  1-  That  is,  the  discriminator  A  slightly  emphasizes  the  signal 
Si(t)  relative  to  the  other  signal,  i=l,2. 

Optimization  Criteria  and  Respective  Algorithms 

Due  to  the  equivalence  cited  above,  we  can  use  for  optimization  criteria  either 
power-power  minimization,  correlation-correlation  magnitude  minimization  or  power- 
correlation  magnitude  minimization  on  the  outputs.  Notice  that  minimization  of 
correlation  magnitude  leads  to  de-correlation. 

Together  with  the  effect  of  the  discriminator,  these  criteria  are  given  by  7 


power-power:  w (t) 
correlation-correlation  :  w(f) 
power-correlation  :  w(f) 
correlation-power  :  w(t) 


w^t) 

'  £{UMsi(i))H  ' 

w2(t) 

—  arc  mill 

0  w 

arg  min 


|£{A(yi(0)y2*(mi2 

\E{yi(t)'D2(y2(t))}\2 


arg  min 


arg  min 


E{myim2) 

\E{yi(t)'D2(y2(t))}\ 2 
E{\D2(y2(tm 


(18) 


By  using  the  steepest  descent  algorithm  with  the  negative  of  the  terms  in  (18)  as 
the  forcing  increments,  we  get  two  linearly  independent  recursive  control  equations. 
For  cr2  =  0  (no  noise)  and  for  |it>i|  <  1,  and  ju^l  <  1,  these  equations  have  a  unique 
solution,  w\  =  aj  and  w2  =  a2  [3]  and  the  bootstrapped  separator  converges  to  these 
values. 

To  summarize:  with  the  backward- backward  separation  scheme,  one  can  use  four 
different  adaptive  separation  algorithms.  They  are  denoted  by  BBPP,  BBCC,  BBPC 
and  BBCP  where  the  first  two  letters  (e.g.  BB)  stand  for  the  configuration  used 
(backward-backward)  and  the  last  two  letters  (say  PC)  stand  for  the  optimization 
criteria  used  for  the  first  and  the  second  weight,  respectively  (say  power-correlation, 
7By  minimization  of  a  vector,  we  mean  -  minimization  of  all  its  components  simultaneously. 
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which  are  minimum  power  and  de-correlation,  respectively).  The  separation  algo¬ 
rithms  related  to  the  above  configurations  are  depicted  in  Fig.  3. 

2.2  The  Forward- Forward  Structure 

In  Fig.  2.b.  the  forward-forward  structure  (FF)  is  depicted.  The  input-output 
relation  for  this  configuration  is  given  by 

y(0  =  W//x(i)  (19) 

where 

w„  =  =  (1  -  w,w,)Wu  (20) 

where  W^,  is  given  in  (6).  Since.  W //  and  W ^  differ  only  by  the  scalar  factor, 
1  —  W1W2,  we  easily  adopt  the  results  of  section  2.1  to  this  case.  In  particular 

y(f)  =  H//s(<)  +  W//n(0  (21) 

where  H/j  =  (1  -  iuiiu2)H66  and 

R/j  =  £{y(*)yw(0)  =  I1  -  ^iw2|2Rw  (22) 

where  Rjj,  is  given  in  (10).  For  this  configuration  it  was  proved  [3]  that,  when  <t2  =  0 
(no  noise),  Hjj  is  diagonal  if  and  only  if  R//  is.  Therefore,  de- correlation  of  the 
output  signal  is  a  useful  criterion  for  signal  separation,  as  in  the  BB  configuration. 
Notice,  however  that  for  this  configuration 

12}  =  -  Wi*2|2}  =  -2F{a$(<)jfi(0}  =  0  (23) 

Therefore,  in  contrast  to  the  BB  configuration  wherein  de-correlation  of  the  out¬ 
puts  and  minimization  of  their  powers  are  equivalent,  in  FF  such  equivalence  does 
not  exist.  Using  de-correlation  as  an  optimization  criterion,  i.e  £{yi(t)yj(t)}  =  0, 
E {yi(t)y2{t)}  =  0,  one  might  control  both  and  w2.  It  is  very  clear  that,  again 
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discrimination  is  necessary  and  the  resultant  separation  algorithm,  denoted  by  FFCC 
(forward -forward  correlation-correlation),  is  depicted  in  Fig.  4. 

As  in  the  previous  structure,  we  may  look  at  each  loop  as  an  interference  canceler 
which  attempts  to  reduce  the  effect  of  the  other  signal.  The  upper  loop  in  Fig.  4 
attempts  to  cancel  the  interference  caused  by  the  input  source  s2(<)  into  Sx(t),  while 
the  lower  loop  attempts  to  cancel  interference  caused  by  the  Si(t)  into  s2(i).  By 
virtue  of  discrimination  which  enhances  the  signal  component  due  to  s2(t)  over  that 
due  to  Si(t),  the  first  loop  is  able  to  perform  partial  cancellation  of  the  interference 
from  s2(t)  into  S\(t).  This  results  in  a  purer  sample  of  S\(t)  provided  to  the  second 
loop  allowing  that  loop  to  perform  a  partial  cancellation  in  the  other  direction  from 
si(t)  into  s2(t).  The  purer  sample  of  s2(t)  is  then  used  by  the  first  loop  to  improve 
cancellation.  The  above  cycle  is  repeated  until  essentially  perfect  signal  separation  has 
been  achieved.  This  argument  lead  to  the  term  bootstrap,  although  no  feedback  has 
been  employed.  In  fact,  unlike  the  BB  structure,  in  the  FF  structure  bootstrapping 
results  from  the  control.  In  [3],  it  was  shown  that  without  noise  (a2  =  0),  the 
resultant  algorithm  converges  to  the  unique  solution  wi  =  and  w2  =  a2  provided 
that  |ai|  <  1  and  ja2|  <  1.  Notice,  however,  that  the  output  signals  are  then  given 
by  yl(t)  =  (1  —  a1a2)s1(t)  and  y2{t)  =  (1  —  ai<z2).s2(>)  and  not  simply  y%{t)  =  s,(t)  as 
in  the  BB  structure.  That  is,  the  signals  are  indeed  separated  but  they  are  scaled  by 
a  factor  which  is  related  to  the  model  parameters. 

2.3  The  Forward- Backward  Structure 

In  Fig.  2.C.,  a  forward-backward  (FB)  bootstrapped  structure  is  depicted.  Its 
input-output  relation  is  given  by 

y(f)  =  W  fbX(t)  (24) 
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where 


WT  1  +  W\W2  —Wi  w  r  1  ,0,v 

W/6  =  _w  J  =  Wff  +  wlw2elel ,  e,  =  Q  (25) 

Therefore,  this  configuration  can  be  alternatively  viewed  as  a  FF  configuration  in 
parallel  with  a  direct  weighted  connection  between  xi(£)  and  y\{t)  (see  Fig.  5).  The 
relation  between  the  signals  to  be  separated  and  the  output  vector  is  then  given  by 
y{t)  =  Hfbs(t)  +  W/(,n(0-  where 

H  jh  =  W/iA  =  H//  +  u’iu’2eief  A 

=  H//  +  u.’iU’2  q  °l  (26) 

The  output  power  matrix.  R/>,  =  £'{y(0yH(0}  is  given  by 

R/6  =  E{y(t)yll>t)} 

Hi  ri:  .  f  ;i  +  U'l^l2  +  ki|2  -u>i|u>2|2  -  iv’2  -  te, 

[  r2 1  r22  [  —  u'j | te2 12  -  u'2  -  w[  1  +  |u;2|2 

where 

^11  =  <7j2|1  -  H'i(a2  -  (C2)|2  -  crjja,  -  uq(l  -  «iU'2)|2 

r12  =  <7i((a2  ~  -  u'2|2)  -  <7 ^ ( if] 1 1  -  (r2a,|2  —  «i ( 1  -  ie2ai)*) 

>"2i  =  cr2((a i  -  iv2)  -  ivjla2  -  u-2i2)  -  cr|( u;j 1 1  -  tc2a,|2  -  aj(  1  -  w2a,))  =  r*2 

r22  =  la2  —  u’2|‘crf  -f  |1  —  u'2«ii*’a2  (28) 

Unsurprisingly,  the  output  power  of  y2(t)  is  as  in  the  FF  configuration,  while  the 
output  power  of  y\{t)  and  the  correlation  E{y\(t)y\{t)}  were  changed.  In  [3],  it  was 
suggested  to  control  u\  by  minimizing  the  power  F’di/dOl2}  and  w2  by  de-conelating 
the  two  outputs  (  or  equivalent ly  by  minimizing  \E{y2{t)y'l{t)}\2)  and  hence  called 
power-correlation  .  With  the  terminology  of  the  appendix,  this  is  FBPC  which  is 
depicted  in  Fig.  6. a.  However,  using  Fig.  2.c.  we  write 

-J—  EflyilOl2}  =  -j!—E{\xi(t)  -  ie,y2(0|2}  =  -2F’{//i(/)i/2(/)}.  (29) 

aw  i  aw  i 
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Therefore,  as  in  the  FF  structure,  we  can  control  by  minimizing  either  the 
output  power  -S’ { ) |2 }  or  the  magnitude  of  the  correlation  |£7{j/2(^)yr(i)} |2-  Also, 
similar  to  the  argument  in  (23),  u.-2.  can  only  be  controlled  by  de-correlating  the  two 
outputs.  In  conclusion,  only  two  control  algorithms  are  possible  for  the  FB  structure: 
the  power-correlation  (FBPC)  and  the  correlation-correlation  (FBCC).  These  two  are 
depicted  in  Fig.  6. a  and  Fig.  6.b.  respectively. 

In  [3]  it  was  shown  that  if  a2  =  0  and  |ai|  <  1  and  |a2|  <  1  then  the  FBPC 
algorithm  converges  to  u?2  =  a?,  and  W\  =  ^-^a[  =  .  Therefore,  the  desired 

outputs  are  yi{t)  =  Si(t)  and  y2(f)  =  (1  —  aia2)s2(<)  so  the  first  signal  is  accurately 
reconstructed  while  the  second  is  multiplied  by  a  scalar. 

Although  all  seven  possible  configurations  of  the  bootstrapped  algorithms  (Figs.  3. a. 
3.b,  3.c,  3.d,  4,  6. a  and  6.b)  completely  separate  the  signal  (in  a  no-noise  environ¬ 
ment),  they  behave  differently.  While  the  BB  structure  resembles  the  AR  model 
process  generator,  the  FF  and  FB  structures  resemble  the  MA  and  ARMA  process 
generators,  respectively.  These  principle  differences  effect  stability,  bandwidth,  con¬ 
vergence,  etc.  Some  of  these  properties  were  studied  and  compared  in  [10].  In  the 
rest  of  this  appendix,  we  concentrate  on  the  effect  of  noise  on  the  average  steady  state 
behavior  of  the  different  structures. 
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3  Steady  -  State  Optimal  Weight  Values 


Since  we  are  implementing  the  steepest  descent  algorithm,  the  steady-state  values 
to  which  the  weights  converge  (on  the  average)  are  the  optimal  values  that  satisfy 
the  corresponding  optimal  criteria.  We  now  study  the  steady-state  behavior  of  the 
different  configurations  in  the  presence  of  noise.  We  do  that  by  looking  at  the  values 
of  the  weights  ivi  and  w2  which  satisfy  the  criteria  of  (18).  We  assume  that  the 
operation  of  the  discriminators  is  described  by  (17)  and  that  it  does  not  effect  the 
noise  processes  ni(t)  and  n2(t). 

3.1  FF/BB  Configurations 

Using  de-correlation  in  FF  configuration,  and  due  to  the  equivalence  between 
power  minimization  and  de-correlation,  in  case  of  BB  configurations,  the  steady- 
state  optimal  weights  of  all  FF  and  BB  configurations  can  be  obtained  from  the 
simultaneous  solution  of 

EiDiiy^yj}  =  0,  and  £^*£>1(1/2)}  =  0  (30) 

From  (12)  together  with  (13),  we  find  that  wlopt  and  w2opt  must  satisfy 

ai(a2  -  w2)‘(l  -  wia2)  +  Sl2crl(l  —  w2ai)‘(ai  -  Wi)  -  a2{w^  +  wx)  =  0 
^2i<Ti(a2  -  w2)(l  ~  Wia2)*  +  0-3(1  -  u?2ai)(a!  -  u;,)*  -  a2{w2  +  wj)  =  0  (31) 

These  are  two  non-linear  equations  in  W\  and  iv2.  The  solution  to  the  equations 
is  the  mean  of  the  steady-state  value  of  the  weights  vector  wopt  =  [w-[0pt  w2opt]T ■  For 
o2  —  0  the  unique  solution  is  W\opt  =  fli,  w2opt  —  a2 .  provided  that  |ai|  <  1,  |a2|  <  1 
[3].  For  cr2  ^  0.  we  write 


u’lopi  a, 


u’2  opt  —  a2  —  e2 


(32) 
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Then,  using  (32)  in  (31)  we  get  the  approximated  matrix  equation  8 


A62USNR2  +  1  A’SNR\  +  1 
A  SNR2  +  1  Am6$1SNRl  +  1 


^2 


(ai  +  a2)  j 


where  A  =  1  -  a,a2,  S7V/?!  =  and  SNR2  =  .  Thus, 


(aj  +  a2) 

‘  A'SNR^S2,  -  1)  ' 

£7 

det 

ASNR2{622  -  1) 

(33) 


(34) 


and 


det  =  |A| 2SNRiSNR2(6l26ll  -  1)  +  A SNR2{6212  -  1)  +  A mS\Rx{622l  -  1)  (35) 

If  a2  — ♦  0  then  SNR\  — ►  oc.  SNR2  —*  oc  and  t  — ♦  0  as  expected.  If  a2  ^  0 
then  e  is  inversely  proportional  to  A  =  1  —  axa2.  Notice  that  |ai|  <  1,  |a2|  <  1  so 
|A|  <  1.  The  weights  and  w2  can  be  regarded  as  estimates  of  the  unknown  model 
parameters  a\  and  a2.  As  such,  they  are  random  variables.  Their  expected  value  is 
given  by  the  solution  of  (30).  From  (32),  we  have 


£{ai}  =  w\oPt  =ax-  ci 

E{a2}  =  w2opt  =  a2  -  e2  (36) 

Thus,  ei  and  e2  of  (34)  represent  the  bias  in  the  estimates  of  the  unknown  model 
parameters.  To  study  this  bias  we  first  assume  that,  S2 j  =  1,  (that  is,  there  is  no 
discrimination  in  the  corresponding  control  algorithms).  In  this  case,  ej  =  0 

(a\  +  a2) AS N R2(622  —  1 )  _  (a^  +  a2)  (aj  +  a2) 

"2  ”  WSNR^NR^  -  1)  +  SNR2 A(S22  -  1)  %  SN% A*  _  SNR, {l  -  a,a2)* 

(37) 


Thus,  the  bias  is  inversely  proportional  to  the  signal-to-noise  ratio  (SNR)  and  to 
the  coupling  effect  in  the  model.  A.  Notice  that  for  |  A|  =  0.  we  must  have  aj  =  a2  =  1 
which  means  that  at  the  inputs  to  the  separator,  the  signals  are  superimposed  equally. 

Mln  the  transition  from  (31)  to  (33)  we  assume  that  1  —  wtai  —  A  +  <i  %  A  and  1  —  w?ai  = 
A  +  <2  55  A.  This  assumption  will  be  discussed  later. 
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|Aj  =  1,  we  must  have  a\  —  a2  =  0  which  means  that  at  the  input  the  two  signals  are 
totally  separated.  In  particular  if 


1  +  t 

- 52—  >  1 

SNRi  A* 


(38) 


then,  the  bias  is  larger  than  the  estimated  parameter.  Similar  results  can  be  obtained 
for  Ci  by  letting  Sf2  =  1.  Thus,  as  a  rule  of  thumb,  it  can  be  said  that  SNRm,nA,  where 
SNRmm  =  min{S N Ri,  S N R2}  is  an  important  design  factor.  If  SNRm^A  >>  1, 
the  bias  in  the  estimates  of  the  model  parameters  might  be  negligible  in  comparison 
to  the  parameter  to  be  estimated  (particularly,  if  ai  and  a2  are  of  the  same  order  of 
magnitude)  and  our  assumption  in  deriving  Eq.  (33)  are  satisfied.  If,  on  the  other 
hand,  the  SNR  is  not  large  enough  or  the  coupling  is  too  strong  so  |A|  <<  1,  then 
the  bias  may  dominate  the  estimate  and  may  cause  severe  degradation  in  separation 
performance. 


3.2  FB  Configuration 

For  the  configurations  depicted  in  Fig.  6. a  and  Fig.  6.b,  w2  =  a2  as  before,  while 
Wi  is  not  an  estimate  of  a  1,  but  rather  related  to  it  through  a'i  =  As  in  section 

3.1.  and  due  to  the  equivalence  between  power  minimization  and  de-correlation,  we 
find  the  steady-state  optimal  values  of  u;}  and  w2  by  imposing  the  de-correlation 
requirement  of  both  discriminated  output  signals,  that  is  from  (27)  together  with 
(28),  we  find  that  Wxopt  and  ii'2opt  must  satisfy 


cri[{a2  -w2)m  -  wi \a2  -  u’2|2)]  -  6\2a\(w\\l  -  w2ax\ 2  -  ai(l  -  w2ai)m) 

—a2{w\  +  W\  +  u-!  |tx^2 12 )  =  0 

d21<72(a2  -  iv2)  -  u-j|a2  -  u’2|2)]  -  <72[u;j|l  -  t^2ai |2  -  aj(l  -  u>2ai)] 

-al{w2  +  w\  +  icj|u;2|2)  =  0(39) 
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Define  cj  and  c2  as  the  bias  in  the  estimate  of  <*i  and  a2  ,  respectively,  so 


opt  =  a2  -  c2 


opt 


1  +  WUptW2opi 

u>\ opt  = 


=  a  I -Cl 


a\  —  Cj 


1  —  (aj  —  ei)(a2  —  c2) 


From  (39)  we  get 


(40) 


(1  -f  wiw2y  ^<TjC2(  A  +  Cia2)"  +  ^i2<t2(A  4-  aic2)cj  —  <72(aj  +  a2  —  cj  —  e2)j 
(1  -f  W1W2)  |^2i<7’i€2( A  +  eia2)  +  ^(A*  -(-  aiej)ei  —  <r2(ai  +  a2  —  t\  —  c2)| 

Since,  \w\w2\  <  1  (by  restriction),  we  can  write  the  approximation  9 


=  0 

=  (ai) 


&6*2SNR2  +  1  A’SNRi  +  1 
ASJVi?2  +  1  A  ’S^SNRi  +  1 


=  (aj  -f  a2) 


(42) 


which  is  exactly  the  same  as  in  (33).  That  is,  the  bias  vector  for  the  unknown  model 
parameters  e  =  [ci  e2]r  is  the  same  for  all  bootstrapped  configurations,  at  least  for 
small  bias,  where  the  approximation  holds. 


9the  assumptions  used  are:  fi a2  <<  A 
the  BB/FF  case,  but  f  1  is  different  here. 


and  f2fli  <<  A,  which  is  similar  to  the  assumption  in 
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4  Example:  Separation  of  Cross  Polarized  Sig¬ 
nals 

In  this  section,  we  apply  the  bootstrapped  signal  separation  algorithm  to  the 
separation  of  cross  polarized  signals  [11].  Dual-polarization  techniques  have  been 
applied  to  radio  communication  networks  to  increase  the  transmission  capacity  of 
limited  bandwidth  channels  such  as  satellite  communication  channels  and  microwave 
radio  channels.  In  a  dual  polarized  transmission  system,  the  available  bandwidth  is 
doubled  by  modulating  the  same  carrier  frequency  with  two  independent  informa¬ 
tion  signals.  The  two  modulated  signals  are  then  transmitted  through  the  channel, 
with  one  having  vertical  polarization  and  the  other  having  horizontal  polarization. 
Because  of  antenna  imperfections  and/or  non  ideal  transmission  channel  conditions 
(caused,  for  example,  by  fading),  the  received  signals  are  not  perfectly  orthogonal. 
Therefore,  cross  polarization  coupling  of  each  information  signal  to  other  is  created 
causing,  in  some  cases,  severe  degradation  in  performance.  The  cross  coupling  pa¬ 
rameters  can  be  assumed  to  be  slowly  time  varying  and  non-dispersive.  Bootstrapped 
separation  algorithms  have  been  proposed  [4,6,12.13]  to  mitigate  degradation  in  per¬ 
formance  due  to  cross  polarization  interference.  It  results  in  an  increase  in  signals 
to  cross  polarization  interference  ratio  and  hence,  an  improved  signal  separation.  In 
this  application,  the  normalized  coupling  factor,  |ai|  and  |a2|  is  sufficiently  small, 
(  —  10 dB  =  10/o^|a,|2)  and  signals-to-noise  ratios  are  of  the  order  of  20  dB  or  more. 
This  leads  to  SN Rmin  A  >>  1  so  that  the  effect  of  the  additive  thermal  noise  is  small. 
In  the  following,  we  present  results  concerning  the  output  signal-to-interference  plus 
noise  ratio  (SINR)  for  three  configurations. 

The  input  SNIR  at  the  channel  output  (at  the  separator  input)  say  xi(t)10  ,  is 
given  by 

10Due  to  symmetry  we  get  similar  expression  for  the  other  input. 
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(  p.l  \  = 

\ P*2  4 -Pn) input  |ax j2cr|  +  cr2 

(  Psi  \  _  SNR\ 

\Ps2+pJ  input  \atfSNR2  +  l  K  ’ 

The  output  SNIR  depends  on  the  steady-state  values  of  the  weights,  and  therefore 
on  €j  and  e2.  In  our  example  taking  |ai|,  ja2|  <  0.3  results  in  jA|  =  |1  —  axa2|  «  1, 
(this  is  a  fair  assumption  in  the  transmission  of  two  orthogonally  polarized  M-ary 
QAM  signals  [6]).  By  taking  SNRi  and  SNR2  >>  1,  one  can  show  that  under  these 
assumptions  the  weight  bias  vector  from  (34)  can  be  approximated  by 


«il 

(aj  4-  <*2) 

'  A  'SNRi  ' 

£2 

~  |A \2SNRlSNR2 

A  SNR2 

This  approximation  is  applicable  to  all  configurations.  Now,  for  both  BB  and  FF11 
we  get  by  using  (12)  with  (13)  and  (22)  the  output  SNIR  at  the  separator  output  at 
2/i  =  -si 


(  — — ^ ) 
\Paj  +  PnJ( 


|1  -  Wiovta2\2al 


(45) 


'  output  |ai  -  Wloptj2*2  +  ff2(l  +  klopll2) 

Substituting  for  wiopt  from  (32)  and  using  the  fact  that  A  a  1  >>  exa2  and 
SNR2  >>  1,  we  get 


(  p-  ) 

\P„  +  PnJ, 


~  |1  —  axa2|2S./Vjlx 

'P32  4"  Pn  J  output  *  |ex|2SNR2  +  l 

Using  the  approximated  ex  from  (44),  we  get 

P„  \  |A|  2SNRl  SNR^ 


(46) 


( -A  ) 

Vft,  +  Pj 


output 


ai+a2  12  .  1  |oi-ea;i2  . 

\-SNR-,!  T  1  SJVR,  1 


(47) 


‘A- SNRi 1  '  '  SNR? 

Notice  that  as  SNR2  — * •  00  the  output  SNIR  approaches  SNR\,  that  is,  as  the 
signai-to-noise  ratio  of  the  second  signal  gets  stronger,  the  interference  cancellation 


11  From  the  relation  between  Rjj  and  Rw  in  (22)  the  output  power  ratios  are  the  same  as  in  BB 
configuration  and  given  by  (45). 
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gets  better.  This  result  is  applicable  to  both  BB  and  FF  configurations  for  any  of  the 
two  outputs. 

For  the  FB  configuration,  by  using  (27)  with  (28)  we  get  the  output  SNIR  at  the 
separator  output  yx  =  si, 

/  P, i  \  _  _ jl  ~  ^lopt(Q2  ~  Wlopttfrf _ 

\P,  j  +  Pn  '  output  Ml  ~  U7lopt(  1  -  W2optai)\2^2  +  ^[l1  +  ^lopt^2opt|2  +  l^lopt|2] 

(48) 


at  y2  —  s2,  using  (27)  with  (28).  the  SNIR  is  given  by 


,  Ps.  +  Pn 


_ |1  ~  w2opta\\2 S N R2 _ 

M2  -  W2oPt\2SNRi  +  [|1  +  |te2op(|2 


Substituting  for  W\opt  and  u;2opf  from  (40)  and  with  high  SNR  assumption  we  get 


*P«+PJ  output 


1  +W1  opt  tu-2 opt 


a2\2SNR , 


Ps-,  +  Pn 


output 


1+^op.^op,1  V 

\A  +  ela2\iSNR1 

Mii 2snr2  +  (1  +  Mi  -  fil2) 

|A  +  cia2l2S/Vfli 

|cn25Ar7?2  -f  1 


psArA  +  d  +  lisS-^pj 


Now  using  ei  from  (44)  we  get 


Pn  +  Pn 


P,7  +  Pn 


i*  + jgfihi  :sN^ 

|A|JS7Vfl2  'r  1 

|1  +  ‘^tfSNRt 

lQl+Q?|2  ,  1 


For  S N R2  >>  1.  +  his  expression,  as  (47)  can  be  approximated  by  simply  SNRX 
(namely,  perfect  cancellation).  However,  for  moderate  levels  of  S.V/?2,  the  output 


SNIR  at  t/i  =  sx  for  the  FB  configuration  is  slightly  higher  than  that  of  the  BB 


configuration  or  FF  configurations.  For  the  other  output  of  the  FB  configuration,  the 
output  SNIR  is  exactly  as  for  the  BB/FF  configurations. 

To  summarize  the  results  of  this  section,  we  notice  for  cases  of  small  coupling 
between  the  signals  and  high  SNR.  such  that  |A|25.V/?j5Afi?2  >>  1,  the  output 
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SNIR  of  any  of  the  bootstrapped  separators  depends  on  the  SNR  of  the  other  signal. 
Practically,  if  the  other  signal  SNR  is  high  enough,  the  cancellation  becomes  perfect. 

5  Conclusion 

To  summarize  the  results  in  this  appendix,  we  emphasize  the  following 

1.  The  basic  2-signals’  separation  cell  contains  two  weighted  and  two  unweighted 
paths.  Each  weighted  path  can  be  either  a  backward  (feedback)  or  a  forward  directed. 

2.  The  basic  optimization  criterion  for  signal  separation  is  the  de-correlation  of 
the  output  signals.  However,  the  backward  path  can  equivalently  be  controlled  by 
minimizing  the  corresponding  output  power. 

3.  Unless  signals  in  the  control  loops  are  somewhat  discriminated ,  the  separation 
problem  can  not  be  solved.  On  the  other  hand,  perfect  separation  is  obtained  for 
infinite  signal  to  noise  ratio  (no  noise)  even  if  the  discrimination  is  slight. 

4.  The  bootstrapped  separation  algorithms  provide  separation  of  the  signals  as 
well  as  estimates  of  the  model  parameters.  With  no  noise,  these  estimates  are  unbi¬ 
ased,  in  the  steady-state.  Additive  thermal  noise  at  the  separator  inputs  causes  bias 
in  these  estimates.  This  bias  is  inversely  proportional  to  the  input  SNR  and  increases 
with  the  signal  cross-coupling.  The  bias  causes  degradation  in  the  separation  perfor¬ 
mance,  but  this  degradation  is  small  if  \A\SNR  >>  1,  where  A  =  1  —  aia2  is  the 
coupling  factor. 

5.  The  effect  of  the  additive  noise  is  an  inherent  factor.  Since  the  input  to  the 
separator  consists  of  the  superimposed  signals  and  uncorrelated  noise  processes,  the 
output,  if  separation  is  done,  consists  of  superimposed  noise  processes  and  uncorre¬ 
lated  signals.  That  is,  the  noise  processes  at  the  two  outputs  are  inherently  correlated. 

6.  It  is  interesting  to  study  the  case  where  only  one  signal  is  present.  This  case 
may  be  realistic  if  one  of  the  signals  to  be  separated  is  absent,  temporarily.  Formally, 
if  one  takes,  say  a\  —  0  in  (12),  we  see  that  any  criterian  used  will  result  in  only  one 
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control  equation  (assuming  no  noise). 


<7j(a2  —  u>2)(l  —  W1W2)*  =  0  (52) 

The  operation  of  a  discrimination  will  not  produce  a  second  linear  independent  equa¬ 
tion  whether  noise  is  present  or  not.  Thus,  the  problem  is  ill-stated  and  it  has  no 
solution  for  wi  and  w? .  This  can  also  be  explained  by  the  fact  that  our  model  assumes 
|ct2|  <  1  and  |aj|  <  1  meaning  that,  at  the  inputs  to  the  separator 

,  .  1  power  of  1  st  signal  1 

at  1  st  input  xj  — — - —  . - r  =  r—jr  >  1 

SN  H  power  of  2  nd  signal  |aj  |2 


.  _  ,  .  .  1  power  of  1  st  signal  .  l2  , 

at  2  nd  input  x2  -7775 - 77  ,  — r  =  ]a2|2  <  1  (53) 

SNR  power  of  2  nd  signal 

where  SNR  =  If  a\  =  0  then  =  0  so  Eq.  (30a)  can  never  be 

satisfied.  Thus,  the  bootstrapped  separator  is  only  applicable  for  separation  of  signals 
and  not  for  noise  reduction,  etc.  (as  the  LMS  algorithm). 

7.  There  exist  many  practiced  important  separation  problems  for  which  NS  NR  >> 
1  (  as  the  cross  polarization  example  of  sect.  IV.).  In  this  case,  the  output  SINR  is 
of  the  order  of  the  input  SNR.  namely  the  separation  is  practically  perfect. 

8.  All  other  papers  dealing  with  the  same  separation  problem  [3,4]  came  to  a  sepa¬ 
ration  configuration  which  is  either  a  BB  or  a  FF  one.  The  papers  which  use  a  similar 
approach  to  ours,  suggest  the  de-correlation  of  the  outputs  as  the  only  optimization 


criteria.  No  other  authors  use  our  “discriminator.”  However,  some  suggested  the  use 
of  nonlinearities  in  the  control  loop,  which  is  a  special  case  of  statistical  discrimi¬ 
nation.  All  other  papers  in  which  the  unknown  model  parameters  are  constants  are 
special  cases,  mentioned  in  our  appendix.  However,  there  have  been  efforts  to  use 
similar  principals  for  model  parameters  which  are  either  digital  filters  coefficients  or 
delay  lines  [14].  In  general,  similar  principles  are  applicable  and  similar  results  are 
available.  There  are,  however  some  differences.  For  example,  in  those  cases,  de- 
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correlation  of  the  outputs  is  a  necessary  but  not  sufficient  condition  for  minimization 
of  the  output  powers. 

Appendix 

It  is  easy  to  show  by  using  (40)  that 


|1  -  wlopt{a2  -  w2opt)\2(j\  = 
|<*i  -  tt>iopt(l  -  w2optax  )|2cr|  = 


1  -  (fll  -  Ci)Q2  2  2 
1  —  (aj  —  ci)(a2  —  t-i)  1 


1  -  (ax  -  ei)(a2  -  c2) 


2 

2 


|1  +  Wioptw2opt\2cr2  = 

KoptlV  = 


1 


1  -  (Cl  -  ei)(a2  -  c2) 

|«i-ei  I2  12 


1  —  (ax  —  cx)(a2  —  e2) 


(A.  1) 
(A.  2) 
(.4.3) 
(A.4) 
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Fig.  2  The  three  configuration  of  the  bootstrapped  signal  separator 

a.  Backward /Backward  Structure 

b.  Forward /Forward  Structure 

c.  Forward/ Backward  Structure 
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Fig.  4  Correlation-Correlation  Optimum  Criterion  for  Forward/ Forward  Structure 

Fig.  5  An  Alternative  View  for  Forward /Backward  Structure 

Fig.  6  Possible  Optimization  Criteria  for  Forward/ Backward  Structure 
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Appendix  C 


Power  -  Power  Bootstrapped  Cross-Pol  Canceler 
for  M-ary  QAM  Signals  -  Performance  Evaluation  and  Comparison  with 

LMS  and  Diagonalizer 

Abdulkadir  Ding  and  Yeheskel  Bar-Ness 

1  Introduction 

With  many  transmission  systems,  capacity  can  be  doubled  by  using  orthogonally 
polarized  QAM  carriers.  The  orthogonally  polarized  waves  can  suffer  degradation  due 
to  carrier  -to-cross  polarization  interference  (C/XPI).  Particularly,  during  multipath 
fading,  such  degradation  could  become  intolerable. 

Many  methods  have  been  suggested  to  cancel  the  XPI.  Among  these  are  the 
diagonalizer  and  the  least  mean  square  (LMS)  cross-pol  canceler  proposed  in  [1].  In 
this  paper,  Kavehrad  compares  the  error  performance  of  these  two  cancelers  and 
concludes  that  the  LMS  is  substantially  better  than  the  diagonalizer.  A  similar 
diagonalizer  was  also  proposed  by  Duvoison  et.  al.  [2]. 

Still  another  method  for  cross-polarization  interference  XPI  canceler  is  termed 
bootstrapped  cancelers,  of  which  three  structures  have  been  proposed  and  analyzed 
in  [3,4,5].  It  has  been  shown  that,  under  the  assumption  of  no  additive  noise  or  when 
the  input  signals  to  noise  ratio  is  very  high,  all  these  structures  converge  to  a  state 
of  total  diagonalization.  In  other  words,  the  XPI  at  each  of  the  cancelers.  two  out¬ 
puts  are  totally  cancelled  similar  to  Kavehrad’s  or  the  other  diagonalizer  considered. 
Nevertheless,  due  to  the  fact  that  these  bootstrapped  structures  differ  from  the  diag¬ 
onalizer  or  the  LMS  cancelers.  the  noise  terms  at  their  outputs  are  different  and  so 
is  the  probability  of  error  performance.  Although  the  bootstrapped  structures  have 
been  implemented  in  different  applications,  such  as  satellite  dual- polarized  communi¬ 
cation  [4],  QAM  microwave  radio  communication  [5]  and  in  tactical  communication 
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[6],  no  attempt  was  made  to  quantify  the  bootstrapped  cross-polarization  cancelers 
(BXPC)  probability  of  error  performance.  In  this  study,  we  derive  the  average  proba¬ 
bility  of  error  of  the  BXPC  as  a  function  of  its  input  signal-to-noise  ratio  and  compare 
it  with  the  performance  of  the  other  two  methods,  the  diagonalizer  and  LMS  which 
were  presented  in  [l].  We  will  show  that  the  BXPC  outperforms  both  the  LMS  and 
the  diagonalizer  in  cancelling  XPI. 

In  this  report,  we  first  introduce  a  model  for  the  dual-channel  M-ary  transmission 
in  section  (2)  and  then  calculate  the  error  probability  caused  by  cross- polarization 
interference  as  well  as  the  noise  section  (3).  Two  interference  cancelers,  namely  the 
diagonalizer  and  the  LMS  cancelers  are  introduced  and  their  error  probabilities  are 
estimated  in  section  (4).  These  results  are  mostly  based  on  previously  published 
material  and  presented  in  this  work  for  completeness  and  the  convenience  of  the 
reader. 

The  power-power  bootstrapped  cross-pol  cancelers  will  be  discussed  in  section 
(5).  There,  after  deriving  the  canceler’s  parameter  such  as  optimal  weights  with  and 
without  noise  effect,  we  find  the  cancelers  optimal  outputs.  Assuming  amplitude 
compensation  alone,  or  amplitude  and  phase  compensation  of  the  cancelers  outputs, 
we  derive  seperately  decision  parameters  for  obtaining  the  corresponding  error  terms. 
In  section  5.2.  we  derive  the  Chernoff  bound  on  the  average  probability  of  error  on 
on°  hand  and  define  an  expression  to  be  used  in  calculating  an  approximation  to  the 
probability  of  error  by  the  method  of  moments,  on  the  other.  Finally,  in  section  5.3. 
we  present  results  on  the  performance  of  the  power-power  canceler  showing  Chernoff 
bounds  and  actual  approximations  to  error  probability  based  on  the  moments,  for 
different  cases  and  with  different  parameters.  These  results  are  also  compared,  in 
order  to  draw  the  conclusions  in  section  5.4. 
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2  Dual-Channel  M-ary  QAM  Transmission  Model 


The  model  for  such  chaunels  have  been  well  presented  in  the  literature  [7,8,9,10]. 
*  !-ary  QAM  bandpass  signals  with  the  same  bandwidth  and  the  same  center  frequency 
transmitted  on  two  orthogonal  channels  can  be  presented  as 

s,(t)  =  Re{si(t)  exp(  j  2  «/c£ ) }  (1) 

where  Re{-}  stands  for  the  real  part,  fc  denotes  the  carrier  frequency  and  sx(t),  i  =  1.2 
is  the  complex  envelopes  of  each  of  the  orthogonal  signals,  respectively.  These  complex 
envelope  can  be  expressed  as 

OO 

m = E  Wni  -  «•)  (2) 

k= 0 

where  h,  i  =  1,2  is  a  complex  information  symbol  which  takes  on  one  of  M  different 
complex  values,  where  Ik,  =  IkR  +  jhl ,  and  IkR  and  Iki  (the  in-phase  and  the 
quadrature  component  of  the  carrier),  are  independent  M-ary  symbols  from  the  set 

{±c.  ±3c . ±(y/M  -  l)c).  IkR  and  hi  can  each  take  values  equal  to  2/  —  1  — 

y/MJ  =  1.2 _ _  y/M.  IkR  and  Ikl  are  assumed  to  be  statistically  independent  and 

equiprobable.  Also,  h(t)  is  a  complex  low-pass  equivalent  of  the  overall  system  impulse 
response.  M  is  the  number  of  signal  level  of  in-phase  and  quadrature  component  and 
c  is  a  constant  which  determines  the  distance  to  the  decision  boundary  from  each 
signal  location. 

The  channel  is  assumed  to  be  slowly  time  varying  and  non-dispersive.  It  accepts 
two  orthogonally  independent  random  data  streams  I\(n)  and  h{n).  It  causes  dis¬ 
tortion;  a  fraction  of  one  stream  of  data  is  added  to  the  other  [10]. 

In  matrix  notation  the  received  signal  is  given  by 

x(f)  =  As(<)  +  n(t)  (3) 


where  A  is  the  dual-channel  cross  coupling  matrix 


A  = 


an  a  12 
a2\  <*22 


(4) 
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ai2  and  a2i  are  complex  valued  constants  that  denote  the  channels  cross-polarization 
(inter-channel  interference)  responses.  The  factors  an  and  a22  denote  co-polarization 
(direct  path  attenuation)  channel  constants  taken  as  real  valued  [1C]. 

In  (3)  s(f)  =  [sx(t),  s2(f)]T  and  the  noise  n(t)  =  [nj(f),  n2(f)]T  with  n,(t )  = 
n,R(t)  +jnu(t),i  =  1,2 

The  received  signals,  sampled  after  matched  filters,  are  denoted  by;(see  Fig  1) 


Xi(n)  =  a1171(n)  +  a12/2(n)  +  nj(n) 
x2{n)  =  a2ili(n)  +  a22I2(n)  +  n2(n) 


(5) 


where  xx(n)  and  x2(n)  are  the  sampled  received  signals  at  the  first  and  second  channels 
respectively.  /,(n)  and  n,(n)  are  the  corresponding  signals  and  noises  at  these  outputs. 
Also  ni(n)  and  n2(n)  are  independent  samples  of  Gaussian  zero  mean  random  process. 

The  channel  coefficients  atj  i  ~  1,2.  j  =  1,2  are  assumed  to  vary  slowly  with 
respect  to  the  signal  rate.  These  slow  variations  can  be  tracked  by  the  adaptive 
algorithms. 

We  define  the  normalized  cross-polarization  coefficients, 


a  22  Qn 


(6) 


where  ri,r2  denote  the  magnitude  of  the  normalized  cross  polarization  constants  and 
0\ .  c>2  are  the  phases  of  these  constants  assumed  to  be  independent  and  uniformly 
distributed  over  [ — 7r,  tt]. 


3  Performance  of  Dual  Polarized  M-ary  QAM 
System 

To  estimate  the  performance  of  such  a  system  and  realize  the  effect  of  cross¬ 
polarization,  we  will  find  an  estimate  for  the  probability  of  errors  that  each  output 
will  suffer.  As  a  standard  procedure,  and  based  on  the  kind  of  signal  processing 
performed  at  the  outputs  of  the  receiver,  we  define  the  decision  parameter.  In  this 
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chapter  we  will  take  as  the  decision  parameter  Ix(n)  =  and  yx(n)  ^  x^n)12.  In 
the  next  chapter  this  normalization  will  be  termed  “amplitude”  only  compensation. 
Define, 

Zi(n)  =  l\(n)  -  Ix(n)  (7) 

From  (5)  and  (7),  we  write 

Zi{n)  —  — h(n)  H -  (8) 

Oil  an  v  ' 

Next,  we  write  Zx(n)  in  terms  of  its  real  ,  Zxr,  and  imaginary, Zxj,  parts.  For  this, 
assuming  an  =  a2 2  we  use  (6)  in  (8)  and  present  I2(n)  and  n^n)  in  terms  of  their 
real  and  imaginary  parts; 

Z\ r  =  rxI2RCOs4>i  —  rxI2lsinox  4-  — — 

an 

Z\l  =  rxI2Rsin<i)i  +  rxI2icosox  +  —  (9) 

an 

For  a  matter  of  convenience,  we  dropped  in  (9)  the  dependence  on  the  sampling 
time  n. 

Based  on  the  decision  parameters  in  (9),  Kavehrad  [l]  finds  the  Chernoff  bound 
on  the  probability  of  error  at  the  output.  He  also  uses  the  Gauss  quadrature  rule  [11] 
to  obtain  an  approximate  value  of  the  probability  of  error. 

For  the  convenience  of  the  reader,  we  will  summarize  Kavehrad’s  GQR  procedure: 

Define, 


then 


=  rx(I2RCOs<f)X  -  I2isin<j>x) 
y  —  Hi* 

an 


zxr  —  X[  +  y 


(10) 


12 when  we  add  canceler;  y*(n)  will  be  the  output  of  the  canceier. 


(11) 


where  Y  ;s  zero  mean  Gaussian  random  variable  with  variance  Therefore,  Z\r 


mi 


is  Gaussian  with  mean  Xi  and  variance  — It  is  possible  to  show  that, 


Ml 


Pi(\ZlR\  >  c|<pi,  I2r ,  hi)  =  2 


(12) 


where 


1  /‘so  —t2 

Q{x]  =  72 


it 


and  a2  = 

n  *■ 


Ml 


Using  the  relation  between  the  probability  of  error  P\(e)  and  Px{\Zir\  >  c),  we 

have  _ 

'  /  1  I*1™'  (13) 


Pi{e\<t>uhR.  hi)  =  2(1  —  -~)Q^an(c- 


) 


where  we  used  the  well  known  relation  between  SNR  and  M-QAM  signal  param¬ 
eter: 


SSR  = 


At  -  1  c2 
3  ai 


Defining  the  random  variable. 


x  = 


-V/ 


(14) 


(15) 


then,  (13)  becomes. 

PiWi)=2(i-^)  (i6) 

The  average  probability  can  be  approximated,  using  the  GQR  by; 

Px{e)  w  2(1  -  —L)  JT  w, Q (a ~  *,))  (I7) 

where  x,  nd  w,  are  the  nodes  and  weights  of  the  GQR  which  can  be  obtained  from 
the  moments  of  the  random  variable  x  defined  in  (15)  together  with  (10). 

Based  on  (17),  we  calculate  and  present  in  Fig.  2  the  probability  of  error  at  the 
output  of  a  channel  for  16  QAM  dually  polarized  signals  as  a  function  of  the  trans¬ 
mitter  signal  to  noise  ratio.  The  cross-coupling  assumed  to  be  -15  dB.  32  moments 
were  used  when  applying  the  GQR  in  (17). 
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4  Cross-Polarization  Cancelers 


We  notice  from  (5)  that  the  output  of  the  channel  contains,  besides  the  noise 
term,  an  interference  (cross  polarization)  through  the  cross  coupling  an  and  a2i ■  This 
interference  undoubtly  causes  degradation  of  performance.  Several  different  canceler 
structures  were  proposed  to  mitigate  the  effect  of  cross-polarization.  Among  these 
are  the  diagonalizer  [10]  and  the  LMS  [12]  and  the  bootstrapped  canceler  [4]. 

For  the  convenience  of  the  reader,  we  will  summarize  Kavehrad’s  approach  to 
estimate  the  performances  of  the  diagonalizer  and  the  LMS  cross-pol  cancelers.  We 
will  introduce  the  decision  parameters  of  these  cancelers  as  they  have  been  derived  for 
M-ary  QAM  system  by  Kavehrad,  follow  his  derivation  for  the  Chernoff  bound  on  the 
probability  of  error  and  compare  the  results  of  these  two  algorithms  with  each  other 
for  different  cross-couplings.  It  should  be  noticed  that  the  decision  parameters  for  the 
outputs  were  derived  in  [1]  under  the  assumption  that  only  amplitude  compensation 
is  used  at  the  output.  Also,  it  should  be  emphasized  that  unlike  the  LMS  canceler, 
Kavehrad  completely  neglects  the  effect  of  noise  on  optimal  weight  when  he  deals 
with  the  diagonalizer. 

4.1  The  Diagonalizer  and  Its  Performance 

The  structure  of  this  canceler  is  well  presented  in  [10],  [l],  see  Fig  3.  The  output 
of  the  diagonalizer  is  given  by 


yi(n)  =  u>uxi(n)  +  u>12x2(n) 

y2(n)  =  u;2iXi(n) -|- ia22x2(n)  (18) 

and  substituting  (5)  in  (18).  we  get 

yi(n)  =  tt'n[au/i(n)  +  ai2I2(n)  +  nj(n)]  +  iai2[a2j/i(/j)  +  a22/2(rt)  +  n2(n)] 
y2(n)  =  u’21[au/i(n)  +  auI2(n)  +  «i(n)]  +  ia22[a2i/,(n)  +  a22I2(n)  -I-  n2(n)]  ’ 
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(19) 

The  canceler  weights  are  found  by  forcing  the  coefficients  of  the  interference  signal 
to  zero  on  each  channel.  Therefore,  from  (19)  we  must  choose  the  weights  to  satisfy, 

i cti 2  "h  W12Q22  =  0 

dj  j  +  tU22Q2i  =  9  (20) 

By  substituting  the  constraint  of  (20)  in  (19),  we  get  after  using  (5). 

yi(n)  =  fln[l -r1r2e-'(4,,+^)][/1fi(n) +.;/!/(»)] +  n1fl(n)+;n1/(n) 

-(n2fi  +  jn2i)rieJ*' 

y2(n)  =  a22[l  -  r1r2ej(^+^)][/2fi(n)  +  j/2/(n)]  +  n2R(n)  +  jn2i(n) 

-(«ir  +  jnu)rie],h  (21) 

Following  Kavehrad,  we  define,  h{n)  —  as  an  estimate  of  the  transmitted 
signal  7i(n)  and  hence  definition  of  decision  parameter  follows 

Zi(n)  =  /1(n)-/1(n)  (22) 

Using  (22)  in  (21),  we  write  the  decision  parameter  for  the  output  of  channel  1, 
in  terms  of  its  real  and  imaginary  parts; 


Zir  =  — /ifl(n)r1r2cos(<^1  +  fa)  +  Iu(n)rxr2sin{<px  +  <j>2) 

,  niR{n)  n2R  n2R  n2/ 

_l - r\cos<t>\  +  — rismoj 

«ll  <*11  <*11  <*11 


Z\i  =  -/i/?(n)r1r2sm(^1  +  fa)  ~  /i/(t*)rir2cos(e>i  +  <z>2) 

n\i(n)  u2r  ti2r  .  n2/ 

H - rising - r\Cos<p ! 

<*11  <*u  <*11  <*11 


(23) 
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The  Chernoff  bound  on  Pi{\Z\R\  >  c)  is  derived  by  [1]  and  some  of  the  steps  can 
be  found  detailed  in  section  (5.2.1)  From  this  analysis,  we  find  that  the  probability 
of  error  is  bounded  as  follows; 

.  1  ,  f  —3  SNR  an  . 

PM  -  (‘  ”  7M)eXPl2(M  -  1)  1  +  SNR  rfr |4  +  r?J  '  =  1,2  (24) 

where  we  again  use  the  relation  (14); 

Kavehrad  in  a  different  paper  [11]  uses  another  form  of  compensation; 

From  (21).  he  first  finds  the  real  and  imaginary  part  of  the  canceler  output, 

Vir  =  <2n[l  -  rxr2cos{<t>x  +  ©2 )]/m(n)  +  anhi{n)rir2sin(<f>i  +  <f>2)  +  niR{n) 
—ri2R{n)r-ycos6\  +  n2/(n)r1sm<^i, 


yu  =  an[l  ~  rxr2cos(<t>i  +  <^)]A/(n)  -  au/ijt(n)rir24in(^i  +  <j>2)  +  ni/(r:) 
—ri2R{n)risinc>i  —  n2i(n)r\Cos<t>x, 


then  defines  an  estimate  of  the  real  part  of  I\(n), 


IiR(n)  = 


_ yiRjn) _ 

an[l  ~  r1r2cos(<p1  +  <p2)]’ 


and  similar  estimate  for  the  imaginary  part  of  7i(n).  For  the  decision  parameter  ZxR, 


then  he  uses 


Therefore. 


Zir{ti)  =  I\r{ti)  -  hR{n) 


Z\R(n)  =  —  [auhi{n)rir2sin{oi  +  o2)  +  nlR{n)-n2R(n)rlcos0i  +  n2/(rc)sm<!>,]  (28) 
A 


where 


A  =  an[l  -  rxr2cos{<i>x  +  d>2)\- 
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This  kind  of  compensation  might  be  considered  as  “both  amplitude  and  phase 
compensation”  of  the  co-pol  channel  response.  In  the  next  chapter,  we  will  use  for  the 
bootstrapped  cancelers,  a  slightly  different  approach  to  Kavehrad’s  compensation;  we 
will  apply  compensation  on  the  complex  output  before  making  a  decision.  Obviously, 
there  will  be  a  difference  in  hardware  needed  to  implement  these  approaches. 

Both  the  Chernoff  bound  and  the  moment  GQR  can  be  used  with  (28).  For  the 
second  approach  one  can  find 

(30) 

where 


A*/ 

Y 


and  a  variance 


r\rilxisin(<t>\  +  fa) 
A(<p  i,  fa) 


1 


A(<£i,  <p2) 


(nlR  -  n2Rricosfa  +  n2/r1smflji] 


*5(1  +  r?) 

[1  -  r\r2cos(fa  +  fa))2 


(31) 


(32) 


Let  x  be  the  random  variable 


x  =  rir2\cos{fa  +  fa)  -  Iusin (ft  +  fa)) 


(33) 


then 

P'<e|*i •*••'»)  =  2<>  -  il«(B -x>)  <3<> 

Equation  (34)  can  be  evaluated  numerically.  Some  results  on  the  performance  of 
the  diagonalizer  of  Kavehrad  are  given  in  the  following  figures.  In  Fig.  4.  we  use  16 
QAM  and  compare  the  error  probability  obtained  with  the  moment  method  to  the 
Chernoff  upper  bound.  The  cross  polarization  used  was  r=-15  dB  Fig.  5  depicts  the 
same  except  for  using  64  QAM  instead.  Comparing  the  performance  when  r=-10  dB 
to  that  when  r=-15  dB  is  done  in  Fig.  6  using  moment  method. 
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4.2  LMS  canceler 


The  structure  of  this  canceler  (Fig  7),  for  dually  polarized  non-dispersive  channels 
is  given  in  [12]. 

For  the  output  of  this  canceler  as  in  (18),  Kavehrad  performs  an  amplitude  nor¬ 
malization  and  obtains  an  estimate  of  the  transmitted  signal  Ii{n)  =  ^ii-1 
i  =  1,2.  The  optimal  LMS  weights  are  found  by  minimizing  the  sum  of  the  squares 
of  the  errors.  £{|ei(n)|2  +  |e2(n)|2},  where 

e,(n)  =  I\{n)  —  I\(n)  f  =  1,2  (35) 

corresponding  to  the  i-th  output  of  the  canceler. 

These  optimum  weights  are  found  by  solving  the  matrix  equation 


Rwopt  —  s 


where 


|x,(n)]2  xj(n)x^n) 
x,(n)*x2(n)  |x2(n)|2 


wopt  ~ 


'nopt 

w 

'2iopt 

w. 

flu 

0\2 

a2i 

a22 

For  E{Ii(n)}  =  £{/2(n)}  and  for  a  complex  Gaussian  noise,  the  optimum  weights 
from  (36)  can  be  used  in  (18)  to  find  the  optimal  output  yi(n).  (see  appendix  B  of 
[1]  for  detail). 

From  the  optimal  output  one  can  derive  the  decision  parameter,  and  use  it  to  find 
an  approximation  to.  or  upper  bound  on,  the  probability  of  error. 

Some  results  of  these  calculations  are  given  in  Fig.  8  to  10. 
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5  The  Power-Power  Cross-Pol  Canceler  Structure 


The  system  in  Fig.  11  depicts  the  structure  of  the  power-power  cross-pol  canceler. 
It  consists  of  two  distinct  control  loops:  Q  —  1  loop  and  the  P  —  wu  loop.  Let 

the  power  ratio  of  the  two  signals  at  point  3,  be  such  that  Ji(n)  >  /2(n).  This  being 
the  input  to  the  weight  w12  results  in  power-inversion  in  /2(n)  >  h(n)  at  point  4. 
However,  point  4,  being  the  input  to  the  weight  u>2i,  results  in  /i(n)  greater  than  /2(n) 
at  point  3.  This  process  continues  resulting  in  a  very  high  at  one  output  and 
in  the  other.  As  a  result,  the  power-power  canceler  acts  as  a  high  quality  power 
separator.  The  adaptive  control  algorithm  varies  the  cancellation  the  coefficient  tr12. 
io2i  so  as  to  minimize  the  power  P  and  Q  at  the  output  of  the  canceler.  The  blocks 
labeled  ”  discrimination”  perform  functions  which  make  the  power  detection  more 
sensitive  to  the  undesired  (ai2/2  at  port  P)  signal  than  to  the  desired  signal  “an/i”. 
The  effect  of  these  blocks  which  will  be  discussed  in  later  sections  and  prove  to  be 
essential  for  the  bootstrapping  operation. 


5.1  Canceler  Scheme  and  Parameters 

As  it  was  discussed  in  section  2  above,  the  received  signals  which  are  sampled 
after  matched  filters,  are  given  by; 

xi(n)  =  anli(n)  +  anl2(n)  +  n\{n) 

(40) 

x2(n)  =  a2i/j(n)  +  a22J2(n)  +  n2(n) 

where  Xj(n)  and  x2(n)  are  the  sampled  received  signals  at  the  first  and  second  channels 
respectively.  7,(n)  and  n,(n)  are  the  corresponding  signals  and  noises  at  these  outputs. 


5.1.1  Canceler  Outputs 

From  Fig.  11  the  outputs  yi(n)  and  y2(rc)  of  the  canceler  are  as  follows 


yi(n)  =  x,(n)  -I-  y2(n)wu 
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y2(n)  =  x2(n)  4yi(n)tu21 


(41) 


Solving  the  system  of  equation  (41)  leads  to 

Xi(n)  4  i2(«)wi2 


yi(»)  = 


V2(n)  = 


1  —  Wi2W2i 


*2  (n)  +  xi(n)tx;2i 


1  —  u»12u;2i 

Substituting  for  Zi(n)  and  x2(n)  from  (40)  we  get 


(42) 


yi(n)  = 

h(n)(an  +  u>i2u2i)  4-  h{n)(ai2  4  wi2022)  +  ^i(n)  4  n2(n)w\2 

(43) 

1  -  wi2w2i 

yi(n)  = 

Ii(n)(a2i  4  w2iOn)  4  /2(n)(a22  4  tn2jai2)  4  n^(n)w2i  4  n2(n) 

(44) 

1  —  W\2W2\ 

5,1.2  Optimal  Weights 

The  control  algorithm  simultaneously  minimizes  the  output  powers 

P(u;'12,u;^)  =  £{|y|d(n)|2}  (45) 


<?K2Xi)  =  £{|j4<(n)|2}  (46) 

where  yu(n)  and  y2(*(n)  are  the  samples  of  the  corresponding  output  after  the  dis¬ 
criminations.  In  fact,  it  simultaneously  searches  for  dE{\yu(n)\2}/dwi2  =  0  and 
dE{\y2d(n)\2} /dw2X  =  0.  where  £{•}  and  j  •  |  denote  the  expected  and  magnitude 
respectively.  The  search  for  optimum  weights  can  be  performed  by  successive  use  of 
the  following  recursive  equations,  provided  that  1  —  u?i2u’2i  ^  0. 

wiV  =  “>;2  ~  *21)  (47) 
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Q 

=  **21  -  /*2^tQK2>  *»2l)  (48) 

where  n\  and  fi2  are  the  constants  which  determine  the  stability  of  convergence. 
The  optimum  weights  that  minimize  the  powers  are  the  steady  state  weights  ob¬ 
tained  from 


dP(tv\2,w'n) 


dw 


12 


WlJ.4) 


dw 


=  0 


=  0 


(49) 

(50) 


21 


From  (43)  and  (44),  we  first  find  the  powers  at  the  output  of  the  discriminators, 


as 


P(W  12,U>2l)  = 


|1  -  wuw21\2 


£ii£{|/i(n)|2}|an  +u)i202i| 


+^12jEl{|/2(«)|2}|ai2  +  ^12^22 12  +  -£'{lnl(n)|2} 


-t-£{|n2(n)|2}|u;12|2J, 


(51) 


Q(Wi2,tV2l)  =  jj— ~^|2  [^21^(l/l(n)|2}la21  +  ^2iau|2 

-{-622^  {|/2(rz)(2}  (a22  +  ^2i<ii2i2  +  £’{|n,(n)|2}!u;2i|2 

+£{|n2(n)|2}]  (52) 

where  6t  J  i.j  =  1.2  denotes  the  effect  of  the  i  th  discriminator  on  the  different  signal 
(/i(n)  or  /2(H))  powers. 
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Notice  that  in  calculating  the  power,  we  assumed  I\(n)  and  /2(n)  are  uncorrelated 
and  zero  mean.  We  will  take  for  the  derivative  of  any  real  function  with  respect  to  a 


complex  variable  [13]. 


d  _  8  .  d 

dw  dwr  ^  dw, 


(53) 


where  w  =  wr  +jwi.  Hence,  for  the  functions  P  in  (51),  we  get,  after  some  algebraic 
manipulation  (see  Chapter  3  of  [14]). 


dP  2(1  —  ^12^21) 


dw\2  |1  -  u?12ie2i 


(an  +  WMa.2i)(a.2i  +  u’2ian)*^n£'{|^i(n)|2} 


+  (<*12  +  W\2CL22){a27  +  ^21^12)  ^12^ {  \h{n)  |2  } 

+£{|71,(n)|2}u,;i  +  £{|n,(n)|2}u,1,]. 


(54) 


Similarly  the  derivative  of  the  power  Q  in  (52)  can  be  finally  written  as. 


dQ 

du)2\ 


2(1  —  W12W21) 

|1  -  u;12^2i|4 


(021  +  W2\an)(o.\\  -f  tai2a2i)  82\E{\I\(n)\2} 


+  (a12  +  U>12a22)"(a22  +  W2iai2)£22£'{|./2(n)|2} 


+  £{|n,(n)j2}u;2i  +  £{!n2(n)|2}u;j2 


(55) 


Provided  |1  -  te12u;2i|  ^  0.  equating  (54)  and  (55)  simultaneously  to  zero  will  result 
in  if120pt  an^  u;2iopt  • 


-1 


w 


12°Pl  ~  Dw 


120pt 


<*11(021  +  ie2ioptan)’^'{|fi(ri)|2}^ii 
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where, 


+<*12(022  +  w2ioptai2)”£{|J2(n)|2}£i2  +  u,2iopt-^{lni(n)l2}  (®®) 


^nopt  =  a2l(a21  +  u>210ptall)*£{IMn)|2}^l 

+<*22(022  +  0J210pta12)*£'{|^2(o)|2}5i2  +  £{|n2(o)|2},  (57) 

and, 

^lopt  =  - ~  a2i(on  +  U7120pta2i)*£{|/i(n)|2}62i 

+022(012  +  UJl20pta22)*£'{|/2(o)|2}^22  +  ^^Opt  ^  i  ln2(n)|2  }]  (58) 

where 

^^lOpt  =:  au(all  +  u,120pta2l)*^'{Ul(”)|2}^21 

+012(012  +  u;i2opt°22)*-£'{|^2(o)|2}^22  +  E  { |ni  (n)|2}  (59) 

The  effect  of  the  discriminators  are  presented  by  6jj  i,j  =  1.2  which  are  real 
valued  satisfying  <§11622  <  ^12^21  •  Note  that,  the  first  and  second  terms  in  (55) 
are  complex  conjugates  of  the  terms  in  (54).  Therefore,  to  find  a  unique  solution 
for  W12  and  1021  using  these  equations,  discriminators  which  enforce  the  constant 
6itj  i,j  =  1.2  satisfying  the  above  condition,  are  essential.  The  simultaneous  so¬ 
lution  of  these  non-linear  equations  give  two  equilibrium  points;  [uj12optl' ^loptll 
and  [u;,2opt2-  u,2iopt2l*  ^ne ’s  a  stable  equilibrium  which  provides  a  solution  to  our 
problem. 


5.1.3  Effect  of  Noise  On  Optimal  Weights 


In  the  absence  of  noise,  that  is  when  £{|ni(n)|2}  =  £{|n2(n)|2}  =  0  the  stable 
equilibrium  points  can  easily  found  to  be 


_  0  12  _  U21 

^nopt  —  ~  »  ^lopt  — 

■  a22  <*11 


(60) 


With  noise,  we  will  write 


a12  021  . 
^nopt  ~  _  ~  £i>  ^lopt  —  +  e2- 

a22  K  an 


(61) 


where  tx  and  e2  are  perturbations,  due  to  noise  on  the  optimal  weights  that  we  intend 
to  find. 

Using  (56)  and  (60)  in  (61),  we  can  finally  write,  after  some  algebraic  manipulation 
(see  chapter  3  of  [14]) 

‘I  =  fi[(“u(7271-l)<M£{|/,(")|2}--E{|n1(n)n)f; 

Aft  L  \  a22  an  / 


+(— )"£{|n,(n)|2}  +  — £{|n2(n)|2}|. 

au  a22  J 


(62) 


where. 

Aex  =  a22^a2ian^ii^{|/t(n)|2}  +  a22o^26i2£J{|/2(n)|2}^tj 
+a22(a22  -  —  ui2)*<5,2£'{|/2(n)|2}  +  £’{|n2(n)|2}|. 

ail  J 

Similar  steps  can  be  followed  to  determine  e2  from  (61)  together  with  (58); 

e2  =  -~-au  [(a^2(  —  —  -  1  )622£{  |/2(n)|2}  -  £{|n2(n)|2}')t; 

^e2  L\  a22an  / 


(63) 


+(— )-£{|n2(n)|2}  +  — Cdn.ln)!1}' . 

a22  an 


(64) 
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where, 


Ac2  =  flu  ^a21an^21^'{|A(Tl)|2}  +  ai2a22^22£{|-Mr0|2})Cl 

+«’,(1  -  — — )*6ji£{|/i(n)|2}  +  £{|n,(n)|2}|.  (65) 

an  a  12  J 

Equation  (62)  and  (64)  can  be  solved  simultaneously  to  obtain 

t,  =  I(k(l  -  ^^l)£(|/,(«)|2}^,  +  Ed-WI1)]  [(^)-£(ln.(n)|!) 

AVI  011  ^22  J  L  Gn 

+2«£{|^(„)nl  -  [.;,(!  -  2!2^)£{|/,(n)|,}«„  +  £<|n,(n)|2}]. 

022  J  l  all  °22  J 

f(“)’£{in1(u)|2}  +  —  £{!n2(n)|2}])  (b6) 

L  an  «22  J/ 

f2  =  ^iffayi-^^l)£{|/2(n)P)fe  +  £{K(n)l2>lf^1£{K(«)l2} 

A*  LL  an  a22  J  Lfl» 

+(^H)*£{|n„(n)|2}j  +  [a22(l  -  —  —  )£{|/2(n)|2}612  +  £{|n„(n)|2}] 
a2  2  J  L  °11  a22  J 

[— £{|n«(n)|2}  +  (— )“£{|n„(n)|2}lj,  (67) 

Lan  a22  -IJ 

with 

A  =  fa22(l  —  — — )'£{|/j(n)|2}6n  +  £{|«n(n)|2}]  [a2i(l  - 

an  022  j  l  aU  “22 

£{i/,(n)|2}621  +  £{|n„(n)|2}]  -  [a^(l  -  —  —  )£{|/i(n)|2}^n 

J  l  flu  a22 

+£{|nn(n)|2}  .  a22(l - —  —  )*£{|/2(n)|2}622  +  £{  lran(n)i2}  . 

an  a 22 

(68) 
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Without  loss  of  generality,  we  will  assume  that  the  noise  variance  in  the  V  and 
H  polarized  channels  are  equal:  .£{|ni(n)|2}  =  -£"{ |«2(^)|2}  =  £{fnn(«)|2}-  This 
assumption  is  particularly  useful  when  calculating  the  probability  of  error.  In  fact, 
this  is  the  most  difficult  case  that  puts  the  worst  requirement  on  the  discriminators. 
Using  this  assumption  and  the  definition  of  the  channel  parameter,  we  can  write  the 
final  expression  of  the  perturbation  t\  and  £2  as  follows: 

First  An  and  A /  be  the  real  and  imaginary  part  of  A,  that  is;  A  =  An  +  j’A/, 
then,  some  algebraic  manipulation  leads  to, 

An  =  -  2rlr'1cos(G>i  ~  02)  +  r\r\).E{\I\{n)\2}E{\l2{n)\2} 

(612^21  —  ^11^22)  +  \<l22\2  E  {\l2{n)\2}  E  {  Inn(rt)|2}(*5l2  ~  ^22)  ~T~  a  11 E  {\  I  l{n)\  }- 
£{|n„(n)|2}(62i  -  $11)  -(I  “  rxr2cos{<px  +  <j>2)),  (69) 

A;  =  [a22£{|/2(n)|2}(612-M-an^{|/i(n)(2}(^i-^ii)  • 

rxr2stn(<f>x  +  <fo)£{K(n)|2}. 

Defining  ; 

_  t\AR  +  Jt\Al 

1  An  +  JA/ 

then. 

Cl  =  cin  +  jcu 


(70) 

(71) 


with 


An  +  A 


7  (tuflAi,  -  ••-i/Af  1  +  j(ci.4/An  —  ci.-tnA/) 
/ 


ti.-i /Ah  ci/t/Af 


(73) 
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_  C1/4/Ar  -  Cl AR&1 
Cl/"  f  A 12  ’ 


|A|2  =  A2*  +  A2. 


From  (66)  with  the  definition  of  the  channel  parameter  one  can  easily  conclude  that, 
r^cosfa  +  r2cosfa  —  r2r2cos(2<£i  +  02)  —  rjr^cos^ij. 


£{|nn(n)|2}£;{|/1(n)|2}(<521-^) 


=  a2!  rxsinO\  -  r2sino2  -  r2r2sm( 20i  +  fa)  -  rir\sinfa  . 


£{K(n)|2}£{|/l(n)|2}(^21-611). 


e2 Ai  =  022  -r,smc>i  +  r2sino2  -  r2r2szrt02  -  r^lsinlfa  +  2  fa)  • 


£{|nn(n)|2}£{|/2(n)|2}(«512-<522). 


t2AR  =  a22  rxcosfa  +  r2cos02  —  r\r2cosfa  —  r^ccs^i  +  202)  . 


£{K(n)|2}£{|/2(n)|2}(612-622), 


Clearly. 


(■2  =  ^2R  +  Jt2I 


Ar  +  A2 


((t2/lRA«  —  e2^i/A/)  +  j{t2AR&l  +  *2A/Ar)], 
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then, 


t2R  = 


*2AR&R  -  C2AI&I 

|A|2 


(82) 


(-21  = 


(2AR&I  +  (2AI&R 


|A|= 


(83) 


5.1.4  Canceler  Optimal  Outputs 


Next  using  (61)  in  (43)  with  wi2  =  w120pt  and  w-i\  =  u>2iopt;  we  obtain  yi(n) 

1 


yi(«)  = 


7i(n)[an  +  ( - 1-  £1)021] 

a  22 


(l_(Z£H  +  <l)(Z^l  +  <2))L 

\  022  ail  / 

+72(n)[ai2  -j-  ( - -  +  ^1)022]  +  ni(n)  +  n2(n)[ - +  €1]] , 

022  U22  J 


(84) 


and  after  combining  terms. 


Vi(n) 


fluA(n)[i 


°12Q21 

QllQ22 


+  ci—]  +  h(n)eia22  +  n,(n)  -  n2(n)—  +  n2(n)ci 
°11 _ 522 _ 

012021  Oi2  a2I 
1 - 1-  - €2  +  - Cl  -  C1C2 


O11O22  022  011 


(85) 


5.1.5  Decision  Parameters  with  Amplitude  Compensation  at  the  Can¬ 
celer  Output 

The  co-pole  horizontally  polarized  signal  at  the  output  of  the  channel  is  on/i(n) 
and  hence,  it  is  reasonable  to  take  yi(n)au  as  an  estimate  of  this  signal  by  compen¬ 
sating  for  the  attenuation  in  the  co-pol  by  an.  Therefore,  we  will  take  h{n)  = 

On 

as  an  estimate  of  the  transmitted  signal  I\(n).  VVe  will  also  assume  the  C1C2  in  (85)  is 
negligible  with  respect  to  the  other  terms  in  the  denominator  of  this  equation.  Hence 
from  (85)  we  can  write, 
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A(n)[l 


012021 

011^22 


a  12  ,  <*2i 

- C2  +  - 

022  011 


«ll 


/i(n)[l 


012O21  .  O21  Oj  2 

- +  — £1  +  — c2  - 

O11O22  On  022 


al2  , 

“ — £2] 
022 


,  T  ,  \  a22  .  «l(w)  ,  . ,  O12  £l  . 

+/2(n)£i —  + - (-  tt2(n)( - b  — ) 

Oil  Oil  O11G22  On 

(86) 


Define, 

Zi(n)  4  ;,(«)-  /.(n),  (87) 

with  Zi(n)  is  taken  as  the  decision  parameter.  That  is,  the  probability  of  error  is 
given  by  Pi(e)  =  P{\Zi(n)\  >  c}  where  c  is  the  half  of  the  distance  between  two 
signals  in  the  corresponding  signal  space.  From  (86)  together  with  (87),  we  can  drive, 
after  lengthy  algebraic  manipulations  (see  chapter  3  of  [14]),  the  real  and  imaginary 
part  of  the  decision  variable  Zi(n); 


Z\r  = 


|Az!2 


Iir{KrZdr  +  KjZdi)  +  I\i(KiZdr  —  KrZdi ) 


CLoo  (Z02 

+/2R(ClR^DR  +  C uZdI ) - (-  hli^R^Dl  -  Cl iZdr)  — 

Oil  On 


,  Zdr  ,  Zdi 

+^1R - b  nll - 

an  On 


+n2R((—  -  nst  )ZDR + (Si  -  as±)zDl] 


011  On 


011  on 


r/  Ci/  rising  txR  r\cos4>\ 

+n2/[( - + - )Zdr  +  ( - 

on  an  On  On 


)^D/]]- 


(88) 


and 
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Zu  -  ,2  -I\r(KiZdr  -  KrZdi)  -  Iu(KrZdr  +  KjZdi ) 


-hR.{t\RZDl  -  Cl iZdr)—  +  hlitiRZDR  +  Cl iZdi)  — 

On  flll 


Zdi  .  Zdr 

-«1H - r  Till - 

Gil  all 


u — Ci/  rjsin^j  tlR  rxcos0  i  , 

+  ( - )ZD/] 

an  an  an  Oil 


r/cift  ricosfa  ,  ,  Ci/  r,5md»i 

+n2/[( - )Zdjr  +  ( - 

On  On  an  an 


)Zdi]^ 


where  Kr  and  A'/  are  the  real  and  imaginary  part  of  K  given  by 


Kr  = 


Kar&r  ~  KAjAr 


KarAi  +  Kai&r 
Ar  +  A2 


KAr  and  KAi  are  given  by 


Kar  =  o22£{|nn(n)|2}A{|/2(n)|2}(^2-M- 


r\  +  r\r2cos{0\  +  o2)  -  r\r2co${<f)\  +  <t>2)  -  r1rlcos{2{0i  +  <j>2)) 


Kai  =  o22£{K(n)|2}A{|/2(n)|2}(6,2-^22). 


rir25in(<^i  +  <p2)  -  r*r2sin(<f>i  +  <£2)  -  r2r25m(2(0i  +  <p2))  (93) 
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while  A/?  and  A /  are  given  in  (69,70).  Note  that  Kr  and  Kj  are  functions  of  the 
random  variables  fa  and  fa.  Also,  the  real  and  imaginary  part  of  the  denominator 
Zd  =  Zdr  +  jZdi  is  given  by 


Zdr  =  1  -  rxricos(fa  +  fa)  +  Kr  +  Vr 


Zdi  =  —  r1r2sin((/>i  -f  fa)  +  Kj  +  Vj. 


|A z\2  =  Zj)R  +  Zqj.  Var  and  VAi  are  the  real  and  imaginary  part  of  V  defined 
as  follows 


Vr  = 


V/iftAfl  +  Va/A  ; 
A2*  +  A? 


V/t/A^  -  VArAi 
Afl  +  Aj[ 


with  Var  and  VAi  are  given  by 


Vi R  =  ai1£{|nn(n)|2}E{|/i(n))2}(62i  —  ^n)  rir2cos(fa  +  fa) 
-rxr|cos(^i  +  fa)  -  r\r\cos{2(fa  +  fa)) 


VAI  =  a*uE{\nn{n)\2}E{\h(n)\2}(62l-6u)  r,r2Sin(^  +  ^) 


+  fa)  -  rjr2sin(2(<fo  +  <z>2)) 


and  A r  and  A /  are  given  in  (69).  Similar  to  the  real  and  imaginary  part  of  A'.  Vr 
and  Vf  are  functions  of  the  random  variables  fa  and  fa. 
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Finally  we  write  the  real  and  imaginary  parts  of  Z\(n)  in  terms  of  the  random 
variable  representing  the  red  and  imaginary  part  of  signal  and  noises  of  channel  1 

Z\ r  =  I\rY\  +  A/V?  4-  I2R.Y3  +  I21Y4  +  nmYs  4-  nuYs  4-  n2R.Yr  4-  nuY%  (100) 

Z\i  =  -IirYi  4-  I\iY\  —  I2R.Y4  4-  I21Y3  —  ti\rY6  4-  nnY$  —  n.2  rYs  4  R2iYj  (101) 

where 


Yx  =  - 


KrZDr  +  KiZdi 

|Az|2 


>2  = 


>3  = 


K,  = 


hiZpR  —  KrZqj 
IAzI2 


022  iirZdr  4  tuZpi 


«n 


IAzI2 


Q22  <1 rZd!  -  tllZDR 


a  11 


|AzP 


(102) 


(103) 


(104) 


(105) 


Ys  = 


>6  = 


>7  = 


y*  = 


Zdr 


au|Azj2 


Zdi 


au|Azi2 


(cir  ~  rjcosd>j)ZpR  4  (ei  1  -  r1sm<^1)Zp/ 
aii|Az|2 


{rjsino  1  -  ei i)Zpr  4  (tiR  -  ricos(j>i)Zpi 
«n|Az|2 


(106) 


(107) 


(108) 


(109) 


|Az|2  =  Z2dr  4  Zh  (110) 

Notice  that  Y< ,  i  =  1.2. .8  depend  only  on  the  random  variables  <t>\  and  ©2- 
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5.1.6  Decision  Parameter  with  Both  Amplitude  and  Phase  Compensation 
at  the  Canceler  Output 

Instead  of  the  amplitude  compensation  used  in  section  5.1.5,  in  this  section  we 
use  compensation  on  both  amplitude  and  phase  of  the  co-pol  signal.  That  is  at  the 
output  of  the  canceler,  the  co-pol  signal  is  the  same  as  that  sent  by  the  transmitter 
and  the  error  will  be  caused  only  by  the  cross  coupling  and  the  noise  processes. 

From  (85)  we  can  write 


yi(n) 


where 


1 

A 7 


/i(n)Ay  +  /2(n)£1a22  +  n^n)  +  n2(n)[-—  +  ex]  (111) 

a22 


A  / 


012O21  .  d\2  ,  a2i 

-  +  f-2 - 1"  £l - (-1^2 

O  na22  0-22  011 


Ay 


—  on[l  — 


Q12Q21 

Olia22 


Oil 


(112) 


and  with  amplitude  and  phase  compensation,  we  take  7i(n)  =  as  estimate  of 

the  transmitted  signal  7j(n). 


Define. 


Z\{n)  =  7i(n)  -  7i(n)  (113) 

with  Z\  denotes  the  amplitude  and  phase  compensated  output  decision  variable  at 
channel  1. 

We  will  perform  an  analysis  similar  to  that  in  the  previous  section  to  find  the  real 
and  imaginary  parts  of  the  decision  variable  Z\{n). 

From  (111)  and  (113)  we  get. 


Z,(n)  =  i 
Ay 


72(o)e1022  +  nt(n)  -I-  n2(n)[-—  +  ei]l  (114) 

L  022  j 
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Using  (6)  in  (114),  we  get  the  decision  variable. 


Z\  =  +  jhl)(^lR  +jen)a22 


+niR+jnu  -  ri(n2R+  jn7i)(cos<f>i  +jsin<p1) 


+{n2R  +  jnn)(eiR  +  (115) 

where  we  drop  the  depenc  ce  of  terms  on  the  sampling  time  n. 

Also  from  (112)  v  real  and  imaginary  part  of  the  denominator  Av  are  respectively 
given  by, 


Av r  =  [1  -  r1r2co3(<p1  +  o2)  +  Vfe]an 


(116) 


Ay/  =  [-r\r2sin(<l>i  +  <i>2)  +  Vj]an  (117) 

where  Vr  and  V}  are  defined  in  the  previous  section.  Clearly  Avk  and  A yi  are  func¬ 
tions  of  the  random  variables  <p\  and  <t>2. 

The  real  and  imaginary  part  of  numerator  of  (115),  Zn  are  given  by 


Znr  =  (JWlK  ~  hiz\i)a22  , 


+tiir  -I-  n2R(elR  -  ncosoj)  -  n2I(tu  -  rx sirupi)  (118) 


Zsi  =  (IlRtll  +  hl^lR)022 


+«!/  +  n2R(tu  -  nsinoi)  +  n2I( eiR  -  rjcosfa)  (119) 
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Finally,  we  can  write  (115)  as. 


— Ni  rAvi  + 


-n2/i[(-ci/  +  r\sin<j>i)AyR  +  (clfl  -  rxcos<j>i)Avl 

+n2/[(£ifi  -  rxcos<t> \)AyR  +  (ci/  -  rjsin^)  Ay/]1  (124) 


with  |Ay|2  =  A2fl  +  A}/ 

Finally  we  write  the  real  and  imaginary  parts  of  Zi(n)  in  terms  of  the  random 
variable  representing  the  real  and  imaginary  part  of  signal  and  noises  of  channel  1 


Z\  R  =  IirYiaP  +  hlY2  AP  +  nl  r)'zAP  +  n\{Y\AP  +  n2 FtYbAP  +  TluY§AP  (125) 

Z\i  =  —I2R.Y2AP  +  hiYiAP  ~  n\p)'4AP  +  rci/V-j/tP  —  n^RYeAP  +  ti2iYsap  (126) 
where 


,,  ClflAy/J  +  Cl/Ay/ 

Yuf  =  “22  |A„P 

(127) 

^  Cl/lAy/  -  Cj/Ayfi 

Y2AP  -  <222  |A>|2 

(128) 

v  -  AyR 

Y*AP  |Ay|2 

(129) 

\r  Ayl 

tAP  ~  |A,I2 

(130) 

(cir  -  ricos6x )Avh  +  (cu  -  r,sm^i)Ay/ 

YmP  '  ""  |A,P 

(131) 

„  (risindi  -  eu)AyR  +  (elfl  -  r^cos^Ayi 

W  -  |A,P 

(132) 

M  =  A2yH  +  A2| 


(133) 
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5.2  The  Performance  Analysis 

5.2.1  ChernofF  Bound 

With  Amplitude  Compensation 

Using  the  real  and  imaginary  parts  of  the  decision  variable  for  channel  1  (100) 
and  (101)  obtained  under  the  assumption  of  amplitude  compensation,  we  calculate 
an  upper  bound  for  the  average  symbol  error  probability  for  the  power-power  scheme 
of  BXPC  with  dual-polarized  M-ary  QAM  system. 

An  error  is  made  on  this  channel  if  the  decision  variable  \Zir\  >  c  or  j  '  I  >  c. 
The  probability  of  error  on  channel  1  can  be  written  [l]  as, 

Pi (e)  =  j[l  -  ^]{/>(|Z1R|  >  c)  +  P(\Z„\  >  c))  (134) 

For  a  bound  on  the  probability,  P(\Z\r\  >  c)  or  P(\Z\j\  >  c)  we  will  use  the 
ChernofF  bound  [1].  Such  a  bound  is  defined  as  follows:  for  any  random  variable  Z 
and  a  constant  c,  one  can  find  a  A  >  0  such  that 

P{Z  >  c)  <  £{eA(Z'e)}  A  >  0  (135) 

Obviously  A  that  minimizes  the  right  hand  side  of  (135)  establishes  the  least  upper 
bound  on  P(Z  >  c).  Using  (100)  in  (135)  we  find 

P(\Zir\>c)  <  e~XcE0lt<l>2^EIlR[exp{XIlRYi )].£/, /(exp(A/i/V'2)]. 

£/jr  [exp( \IMY>)].Ehl  [exp(  A I2IY4 )] . 

^n1R[exp(An1/?V5)].£ni/[exp(An1/r6)]. 
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(136) 


£„2<?  [exp(  Xn2R  V7 )] .  Enjl  [exp(  An2/  Y '8 )]  | , 

where  we  used  the  fact  that  7,h,  /,/,  niR  and  n,/,  i  =  1,2  are  independent  of  each 
other.  Also  note  that  all  the  expected  value  operations  inside  ihe  large  parenthesis, 
are  conditional  on  <t> j  and  <?2,  and  hence  the  random  function  Y,  i  =  1,  ..8  conditioned 
on  <{> i  and  d2  are  constant  with  respect  to  these  operations. 

Following  Kavehrad  [1],  we  derive  these  expected  values:  The  random  variable  7lfl 
is  a  discrete  M-ary  random  variable  which  takes  the  values  {±lc.  ±3c.  ..±(^/(A7)— l)c} 
with  equal  probability.  For  such  a  random  variable,  we  derive  in  appendix  A  an  upper 
bound  on  £{exp(a7i/*)},  with  a  given  constant  a. (see  detail  in  [14] ). 


v  /  * 

EhH[exp{XhRYt))  =  £  cosh[{\Yi)(2i  -  l)c] 


<  exp(yc2^-iy,2) 


(137) 


and  terms  are  in  effect  for  the  other  terms  in  (136).  The  additive  noise  rc,(n)  and 
n2(n)  are  assumed  to  be  independent  samples  of  zero  mean  complex  Gaussian  random 
variables  with  £{|n,(n)|2}  =  2<r2  i  =  1,2.  Therefore,  ntR  and  n,/  i  —  1,2  are  real, 
zero  mean  Gaussian  random  variable  with  variance=  er2.  For  such  a  random  variable 
n  .  we  can  derive  the  value  of  £{exp(an)}  with  a  as  given  constant.  Again  noting 
that  conditioned  on  (f>\  and  o2.  AV'5  is  a  constant,  and  hence 


£niR[exp(Anlfir5)]  =  expl^-cV2}^).  (138) 

and  terms  are  in  effect  for  the  other  terms  in  (136).  Finally,  by  collecting  term,  we 
get 


P{\Z\r\  >  c)  <  EOu07{exp{-\c  +  \2[U{<j>U(j)2)  +  W(oi.o2)})}  (139) 
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where 


A  M  -  1 

V(4>uh)  =  §— j-W  +  1?  +  V?  +  Yfi 


W(<h,M  =  + 1?  + 1?  +  *?) 


(140) 


Minimizing  the  exponent  of  (139)  with  respect  to  A,  we  obtain  by  using  (140)  the 
least  upper  bound 


P(\Zir\  >  c)  <  £*,„fc{exp( 


— c 


)} 


(141) 


where. 


C/i(0i,  02)  =  n2  +  Y*  +  r32  +  Y* 


(142) 


wito.fc)  =  y52  +  n2  +  >;2  +  y82 


Rearranging  terms,  we  get 
/3(|Zifl|  >  c)  <  |exp[ 


— c 


-1 


2[c2-  -”^-  fa)  +  Wx(fa,  fa)] 


]} 


=  E, 


4>\ 


,^{exp[ 


-3{SNR) 


2{M-l)[(SNR)Ul(fa,fa)  +  W , 


l($li  to)]-  J 


(143) 


where  in  the  last  step,  we  used  (see  [17]) 


snr  =  1  =  m-'c1 


144) 


N  3  a\ 

Due  to  symmetry  P{\Z\r\  >  c)  =P(\Zu\  >  c).  By  using  the  minimum  upper 
bound  on  P(\Zir\  >  c)  from  (143)  in  (139),  we  can  write  the  resulting  least  upper 
bound  on  the  probability  error 
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A(e)  < 


(i _ L)_L 

VM  4tt2' 


ff 


exp 


-3  (SNR) 


L  2(M  —  1)  (SNR)U1(ol.fa)  +  W1(fa,fa) 


dfa  d<f>  2 


(145) 


where  we  used  the  fact  that  probability  density  function  of  fa  i  =  1,2  are, 
p{fa)  =  P(h)  =  7T- 

In 

With  Amplitude  and  Phase  Compensation 

To  calculate  the  Chernoff  bound  in  the  case  where  the  decision  variable  is  obtained 
with  both  amplitude  and  phase  compensation,  we  follow  the  same  steps  as  in  the 
previous  section  except  with  a  different  value  of  Y{  i  =  1,2..,  6. 

As  in  (139)  we  have  here 

r  \2_2  _  i 

P(|ZiBl>c)  <  £*,.w{exp[-Ac+  —  '—^-(Y;tp  +  Y]AP) 

+  —2~<Tn(Y3AP  +  Y\AP  +  Y*AP  +  ^6>ip)]|  (146) 

where  Y{ap  1  =  1.2.  ..6  are  defined  by  (127)  to  (132). 

Minimizing  the  right  hand  side  of  (146)  and  taking  the  expected  value  over  fa 
and  d>2,  we  write  error  the  bound  for  the  amplitude  and  phase  compensated  channel 
1  output, 


P,apW  <  (1--^=)^. 


u: 


exp 


r-3(SA‘/?) 


L  2 ( A/  —  1 )  (SN R)U\ap\Q\.  02)  +  14  mp(0i,02) 


dd>\dfa 

(147) 
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where 


UlAPihifa)  =  YlAP  +  Yj AP 


WlAp(*  uto  =  Y32ap  +  Y2AP  +  Y2AP  +  Y2AP 


(148) 


and 


eye.  S  _M-IC2 


(149) 


5.2.2  Method  of  Moments  for  Probability  of  Error  Calculation 


In  some  cases,  the  ChernofF  bound  might  not  be  sufficiently  tight  [17].  Therefore 
to  use  it  as  a  measure  of  performance  in  comparing  different  systems  might  not  be 
adequate.  Hence,  in  this  section,  we  will  present  another  method  which  actually  com¬ 
putes  an  approximation  rather  than  a  bound  for  the  average  probability  of  error  for 
the  power-power  scheme  of  BXPC.  The  method  is  based  upon  Gauss  quadrature  rules 
(GQR)  which  were  shown  to  assure  accurate  and  satisfactory  results.  We  will  first  give 
a  brief  description  of  GQR  and  apply  it  to  calculate  the  average  probability  of  error 
of  the  power-power  scheme.  These  calculations  will  be  performed  for  both  amplitude 
compensated,  and  amplitude  and  phase  compensated  received  signals,  respectively. 

With  Amplitude  Compensation 

Using  (100)  in  (134),  we  find  the  conditional  probability, 

P(\Zir\  >  c\(j>i ,  ^2,  Iir,  Jih  J2R1  Jn)-  For  this  we  define  Z\r  =  Xi+Y  with  the  random 
variable  Y  —  tiirY$  +  nuY&  +  n2/?}':  +  n2/Vg. 

The  random  variable  Y  is  zero  mean  Gaussian  and  have  variance 

»’(*!•  oji  =  (Vj2  + >;2  +  y7‘  +  i»V2  (150) 

Conditioned  on  <t>\. 02, 1  \r,I\i,  I2R  and  /2/  ,  the  random  variable  Z\r  is  Gaussian  with 
mean  equals  Xj  and  variance  <r:(Oi.  o2).  Therefore 

P[\Z  r\>  C\<h, *2,  hRiIuJiR.  hi)  =  -J=  Jc  exp^^-j^-^— — -j  'jdziR 
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Hence. 


P(\Zir\  >  c\fa,fa, hR,hi,hR,hi)  =  2 Q( - -)  (151) 

<T 

where 

Q(x )  =  yjtfa  j  exP(_2— )  ^  (152) 

Again  due  to  symmetry  P(\Z\r\  >  c)=  P(\Zu\  >  c),  so  that  together  with  (134), 
we  can  write 


Pl( 

e|x:)  =  2(i  )Q(  x), 

V  Atf  On 

(153) 

where  the  random  variable  x; 

C-Xl 

(154) 

with 

X  =  - - 

O0 

A 

=  (Yi  +  Y*  +  r72  +  Yf)c\ 

(155) 

is  a  function  of  the  random  variables  (fa,  fa,  IlR,  In,  I2r ,  /2/). 

Clearly,  the  average  error  probability  on  channel  1  can  be  evaluated  from 

P\(e)=  J  Pl(t\i)fx(x)dx  (156) 

with  fx(x)  as  the  pdf  of  the  random  variable  x. 

Lsing  the  method  of  moments  in  calculating  (156),  we  get  by  using  (149) 

a(e)  =  2(,--^)|„ig(/fMIj)  (157) 

The  GQR  nodes  x,  and  the  weights  W{  are  determined  from  the  moments  of 
random  variable  x. 

Using  the  Gauss  Quadrature  integration,  the  average  probability  of  error  in  (157) 
can  be  calculated  numerically  by  evaluating  the  2 N  +  1  moments  of  random  variable 
x  in  ( 154).  One  can  derive  a  general  equation  for  the  moment  of  x. 
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£<*°}  =  E(i)«*(-ir‘E  (Bm*)  e{a.b,}  ass) 


where 


-  V  (  m  ^  Tl  A” 

"SI' )  'Rvu 


{m-l)  ^2 


(m-0 


Bx 


_  n  v-'m  (  n  —  k  —  m  \  .u  Y$  .(n 

~  h  l  «  J/2^  2/ 


V' 

-k-m- u)  -*4 


(n-k-m—u) 


(159) 


Recall  that  i  =  1,2,  j  =  R,  I  are  all  independent,  equally  likely  M-ary 

symbols  from  the  set  {±lc,  ±3c, . ±  (y/M  —  l)c},  and  H,  k  —  1, 2.. 8  are  functions 

of  <f>i  and  4>2  which  are  independent  and  uniformly  distributed  over  [— 7r,  -].  In  the 
processes  of  evaluating  (159),  we  note  that  the  n  th  moment  of  equally  likely  M-ary 
symbol  [17,18]  is  given  by 

1  VW-i 

£l. ,{ I?,)  =  £ '  (2m  +  1  -  >/M)’c",  (160) 

and  for  the  case  of  independent  and  zero  mean  M-ary  symbols  /tJ,  we  have 

£lyju =  0  i  ±  k,  or  j  £  l 

Ei^Ii,}  =  0  i  =  l,2j  =  /,fi  (161) 

Furthermore  for  the  n  th  moment  of  YJ  i  =  1,  ..8  which  are  function  of  ox  and  4>2, 
we  use 

E+^m+u+i)*}  =  jT  jT  Yiituhrf^, ♦,(*!,**)  d<t>ud62 

=  /,/  ^(^i’^2)nA1(^i)/<92(^2)  d<t>xdo2  i  =  1. 2..8 

(162) 
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With  Amplitude  and  Phase  compensation 

Similar  analysis  is  used  to  find  the  average  probability  of  error  for  the 

case  when 

the  decision  variable  is  obtained  with  both  amplitude  and  phase  compensation. 

In  this  case,  using  (125),  we  first  calculate  the  conditional  probability, 

P{\Zin\  >  c\<f>i,<f>2,l2R,hi)-  That  is,  we  integrate  on  the  joint  probability  of  the 

random  variable  Yap , 

Define 

Yap  =  kirYzap  +  nuYiAP  +  «2 rYsap  +  n2i\6Ap 

(163) 

Xiap  =  I2RY1AP  +  I21Y2AP > 

(164) 

then  from  (125), 

Zir  =  Xiap  +  YAp 

(165) 

The  random  variable  Yap  is  zero  mean  Gaussian  and  has  variance 

02)  =  02u>  +  Yl*r  +  *2u>  +  C)»; 

(166) 

Also  conditioned  on  <t>\,o2.  I2r  and  hi ,  the  random  variable  Zir  is  Gaussian  with 

mean  equals  Xiap  and  variance  ^Iap^u^i)-  Similar  to  (153), 

iW(e|5>i.o,,  W„)  =  2(1  -  --L )(?(17~)- 

(167) 

or 

PiAPie |xAp)  =  2(1  -  -j=)Q{^-x Ap), 

(168) 

where  the  random  variable  xap, 

c  —  Xiap 

(169) 

xap  - 

O0AP 

with 

=  (V32ap  +  YZap  +  *2u»  +  YLp)c\ 

(170) 
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is  a  function  of  the  random  variables  (<£1,02, I2R,  hi)-  Because  of  independence  as¬ 
sumption, 


fXAp(X^  ~  fh ;R(^2R)/l2i(^2/)/*i(^l)/^2(^2)  (171) 

Similar  to  (157),  we  can  use  GQR  to  calculate  the  probability  of  error  from  the 
moments  of  the  random  variable  Xap;  viz, 

p^)=2^-7m4 ,172) 

where  again  x i  and  wt  are  the  nodes  and  the  weights  of  the  GQR. 

The  moments  of  Xap  can  be  calculated  using  the  simple  binomial  rule 


KU>| 

(  n  ) 
{  k  ) 

|  c*(-i  r‘(  wup + /wiw-*  1 

<AP  J 

£{xXp)  =  £{ 

We  take  the  expected  values  of  the  inner  terms  in  (173),  then, 

£{*ap)  =  £  ( l ) 


(173) 


(174) 


where 

AxAP 

5.3  Results 


■  !(":*) 


y/  v(n-fc-/) 

MAP  j(n-fc-l)  *2, 


rl  M  AP 
[2  RZZ  l2l 
ffoAP 


2  AP 

■pTI 

~oAP 


(175) 


The  Chernoff  upper  bound  on  the  average  probability  of  error  as  a  function  of 
signal- to-noise  (SNR)  ratio  is  evaluated  for  various  cross  coupling  constants  and  for 
16  QAM  and  64  QAM  signals.  The  Gauss  quadrature  rule  is  also  used  to  find  ap¬ 
proximations  to  the  probability  of  errors. 

In  Fig.  12,  the  bounds  on  error  probability  with  16  QAM  and  with  cross  polariza¬ 
tion  coupling  r=  -15  dB,  -10  dB  and  -5  dB  are  calculated  and  compared.  Equation 
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(145)  is  used  in  calculating  these  bounds  when  only  amplitude  compensation  is  em¬ 
ployed,  while  (147)  is  used  when  both  amplitude  and  phase  compensation  is  employed. 
Notice  that  adding  phase  compensation  improves  the  bound  when  the  cross  coupling 
is  high  (i.e.,  r=-5  dB).  The  effect  of  adding  phase  compensation  is  hardly  noticeable 
with  low  cross  coupling  (r=-15  dB).  Fig.  13  depicts  the  same  for  64  QAM.  The  effect 
of  compensation  is  similar.  Nevertheless,  as  expected  the  bounds  are  higher  for  64 
QAM  displaying  possibility  of  higher  error  rates  with  the  same  SNR.  Comparison  of 
these  bounds  for  16  QAM  and  64  QAM  are  shown  in  Fig.  14. 

In  Fig.  15  and  Fig.  16  we  depict  the  probability  of  error  as  it  is  calculated 
using  the  Gauss  quadrature  rule,  for  16  QAM  and  64  QAM,  respectively.  These 
calculations  were  done  with  cross  coupling  of  -15  dB.  -10  dB  and  -5  dB,  and  in  each 
a  total  of  9  moments  were  used.  Only  the  case  with  amplitude  compensation  was 
shown  since  adding  phase  compensation  did  not  change  these  results  very  much.  In 
order  to  show  how  tight  are  the  Chernoff  bounds  shown  in  in  Fig.  12,  we  depict  in 
Fig.  17  a  comparison  of  the  results  obtained  with  GQR  moments  calculations  to  their 
corresponding  Chernoff  bounds  for  16  QAM  and  cross  coupling  of  -15  dB,  -10  dB  and 
-5  dB.  Fig.  18  shows  the  same  for  the  64  QAM  case.  To  show  the  effect  of  increasing 
the  number  of  moments  used  in  obtaining  the  GQR  results,  we  show  in  the  next  two 
figures  these  results  with  7,  9  and  11  moments.  Chernoff  bound  was  added  to  these 
curves  for  comparison.  In  Fig.  19.  we  present  these  comparisons  for  the  16  QAM 
case,  while  Fig.  20  presents  the  same  for  the  64  QAM  case. 

It  is  important  to  emphasize  that  the  error  probability,  although  an  important 
factor,  is  certainly  not  the  only  advantage  of  the  bootstrapped  canceler.  We  mention 
the  following  other  points  in  favour  of  these  cancelers: 

1.  Under  the  same  system  condition,  the  bootstrapped  canceler  steady  state  in¬ 
terference  residue  is  smaller. 
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2.  To  implement  the  bootstrapped  algorithm  one  needs  less  complex  hardware 
than  for  the  diagonalizer,  which  needs  a  zero  forcing  algorithm,  and  for  the 
LMS  canceler,  which  needs  decision  feedback  information.  In  fact,  it  is  clear 
that  adding  a  decision  feedback  to  the  bootstrap  schemes  will  result  in  faster 
convergence  and  still  better  performance  than  that  which  we  obtained  in  the 
current  analysis. 

3.  The  fact  that  the  bootstrapped  cancelers  do  not  need  decision  feedback  makes 
them  ideal  for  acquisition  and.  hence,  suitable  for  channels  with  fast  and  deep 
fading  which  causes  occasional  system  outage. 

In  Fig.  21,  we  compare  the  performance  of  the  power- power  canceler  to  that  of 
the  LMS  canceler,  for  16  QAM  and  r  =  — 10  dB.  Fig.  22  depicts  the  same  comparison 
with  r  =  —15  dB.  To  emphasize  the  need  for  cancelers  in  dual  polarized  systems,  we 
add,  to  these  two  curves,  the  error  performance  without  cancelers. 

Figs.  23  and  24  are  the  same  as  Figs.  21  and,  22  except  for  the  use  of  64  QAM 
instead  of  16  QAM.  In  the  last  four  figures,  the  moment  method  was  used.  For  each 
curve,  the  number  of  the  moments  is  marked  in  parentheses. 

The  three  cancelers,  power-power  canceler,  LMS  canceler  and  the  diagonalizer, 
are  compared  in  Figs.  25  and  26.  A  16  QAM  signal  is  assumed  in  these  figures, 
with  r  =  — 10  dB  and  r  =  — 15  dB.  respectively.  Although  GQR  calculation  has 
been  done  for  amplitude  and  the  phase  compensated  diagonalizer  (see  chapter  2), 
the  GQR  calculation  has  not  been  done  for  the  amplitude  compensated  diagonalizer. 
Therefore,  the  comparisons  are  based  on  the  Chernoff  bound. 

5.4  Conclusion 

The  power-power  bootstrapped  canceler  was  analyzed  and  its  performance  was 
studied  in  this  chapter.  In  particular  the  average  probability  of  error  was  estimated 
using  the  moment  generating  method  or  by  finding  the  Chernoff  bounds.  Results  of 
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the  analysis  as  well  as  computer  calculations  show,  as  expected,  that  16  QAM  perfor¬ 
mance  is  much  better  than  64  QAM.  It  is  also  shown  that  adding  phase  compensation 
to  the  canceler  output  adds  very  little  to  the  performance,  when  only  amplitude  com¬ 
pensation  is  included. 

From  comparing  the  results  obtained  with  the  moment  generating  method  to 
the  corresponding  Chernoff  bound,  we  concluded  that  these  bounds  are  sufficiently 
tight.  Comparing  the  results  when  different  numbers  of  moments  are  used,  and  the 
concluded  tightness  of  the  Chernoff  bound,  we  infer  that  approximately  10  moments 
are  sufficient  for  deriving  a  good  approximation  for  the  average  probability  of  error 
using  the  Gauss  quadrature  rule. 


139 


References 

[lj  Kavehrad,  M.  “Performance  of  Cross-Polarized  M-ary  QAM  Signals  Over  Non- 
dispersive  Fading  Channels”,  AT&T  Bell  Lab.  Tech.  J..  Vol.  63,  pp.  499-521, 
March  1984. 

[2]  Duvoisin  P.,  et.  al.,“  Performance  of  the  Adaptive  Baseband  Diagonalizer,  A 
Crosstalk  Canceller,  in  Dual-Polarized  16-QAM  System”  Record,  IEEE  South¬ 
eastern  ’ 88 ,  Knoxville,  TN,  April  10-13,  1988. 

[3]  Bar-Ness  Y.,  and  Rokach.  J.,“  Cross-Coupled  Bootstrapped  Interference  Can¬ 
celler”,  Int.  Conf.  on  Ant.  and  Pro.,  Vol.  I.  pp.  292-295,  June  1981,  Los  Angles. 
CA. 

[4]  Bar-Ness  Y.,  et  al.,“  Bootstrapping  Adaptive  Cross-Pol  Canceller  for  Satellite 
Communications”.  Int.  Conf.  on  Comm.,  June  1982,  Philadelphia,  PA. 

[5]  Carlin,  J.,  et.  ai..“  An  IF  Cross-Pol  Canceler  for  Microwave  Radio,”  IEEE  J. 
Select.  Areas  Commun .,  Vol.  SAC-5,  No.  3  pp.  502-514,  April  1987. 

[6]  Bar-Ness  Y.,“  Bootstrapped  Algorithm  for  Interference  Cancellation,”  AFCEA- 
IEEE  Technical  Conference  Tactical  Comm.,  Fort  Wayne.  Indiana,  May  1988. 

[7]  Chu,  T.  S., “Restoring  the  orthogonality  of  two  polarizations  in  radio  communi¬ 
cation  systems,”  Bell  Sys.  Tech.  J.,  Vol.  50.  pp.  3063-3069.  Nov.  1971. 

[8]  Lin.  S.  H., “Impact  of  Microwave  Depolarization  During  Multipath  fading  on 
Digital  Radio  Performance,”  Bell  Sys.  Tech.  J.,  Vol.  56,  No.  5,  pp.  645-674,  May 
1977. 

[9]  Steinberger,  M.  L.,  “Design  of  a  Terrestial  Cross-Pol  Canceller,”  Int.  Conf.  on 
Commun.,  Philedelphia,  PA,  June  1982. 

[10]  Amitay  N.,“Signal-to-Noise  Ratio  Statistics  for  Nondispersive  Fading  in  Radio 
Channels  with  Cross  Polarization  Interference  Cancellation  ."  IEEE  Trans.  Com¬ 
mun.,  Vol.  27,  pp.  498-502,  Feb.  1979. 

[11]  Kavehrad,  M.  et.  al..“On  the  Performance  of  Combined  Quadrature  Amplitude 
Modulation  and  Convolutional  Codes  for  Cross-Coupled  Multidimensional  Chan¬ 
nels,”  IEEE  Trans.  Commun..  Vol.  34,  pp.  1190-1201,  Dec.  1986. 

[12]  Nichols  H.  E.,  et.  al..“MLD  and  mse  Algorithms  for  Adaptive  Detection  of  Dig¬ 
ital  Signals  in  the  Presence  of  Interchannel  Interference,”  IEEE  Trans.  Inform. 
Theory,  Vol.  IT-23.  No.  5,  pp.  563-574,  Sept.  1977. 

[13]  Widrow,  B.  et.  al.  The  Complex  LMS  Algorithm  ,”  IEEE  Proceedings  ,  Vol. 
63  ,  No.  12,  pp.  1692-1716,  Dec.  1975. 

[14]  Dine,  A.  .“  The  Theory  of  Bootstrapped  Algorithms  and  Their  Applications  to 
Cross  Polarization  Interference  Cancelation  ,”  Ph.D  Dissertation  ,  N.J.  Ins.  of 
Technology,  May  1991. 

[15]  Gautschi,  W.,“  On  the  Construction  of  Gaussian  Quadrature  Rules  from  Modi¬ 
fied  Moments,”  Math  Comput..  Vol.  24,  pp.  245-260,  Apr.  1970. 

[16]  Golub,  G.  H.  and  Welsch.  J.  H..“  Calculation  of  Gauss  Quadrature  Rules.””  Math 
Comput.,  Vol.  26,  pp.  221-230.  Apr.  1969. 


140 


[17]  Benedotto.  S.  et.  al., “Error  Probability  in  the  Presence  of  Intersymbol  Interfer¬ 
ence  and  Additive  Noise  for  Multilevel  Digital  Signals,”  IEEE  Trans.  Commun., 
Vol.  21.  pp.  181-190,  March  1973. 

[18]  Korn,  l.. “Digital  Communications ,”  Van  Nostrand  Reinhold  Company  1985. 


141 


WITHOUT  CANCELLER 


Fig.  2  Performance  of  Dually  Polarized  16  QAM  System,  without  Cross-Pol 

Interference  Canceler 
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P(symbol  error) 


DIAGONALIZES  SCHEME 


Fig  4  Diaeonalizer  Cross-Pol  Interference  Canceler.  Chernoff  Bound  and  GQR 
calculation  with  amplitude  and  phase  compensation,  cross  coupling  -15  d«. 
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OIAGCNAUZES  SCHEME 


P(symbol  error) 


OlAGCNAUZES  scheme 


Fig.  6  Diagonalizer  Cross- Pol  Interference  Canceler.  GQR  calculation.  16  vs.  64 
QAM  with  amplitude  and  phase  compensation,  cross  coupling  -15  dB.  -10  dB. 
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Least  Mecn  Square  Scheme 
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Fig.  8  LMS  Cross-Pol  Interference  Canceler.  Chernoff  Bound  and  GQR  calculation. 
16  QAM  with  amplitude  and  phase  compensation,  cross  coupling  -10  dB. 
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Fig.  9  LMS  Cross-Pol  Interference  Canceier,  Chernoff  Bound  and  GQR  calculation. 
16  QAM  with  amplitude  and  phase  compensation,  cross  coupling  -15  dB. 
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Fig.  10  L\IS  Cross-Pol  Interference  Canceler,  Chernoff  Bound  and  GQR  calculation, 
64  QAM  with  amplitude  and  phase  compensation,  cross  coupling  -15  dB. 
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POWER-POWER  SCHEME 


Fig.  12  Power-Power  Cross-Pol  Interference  Canceler,  Chernoff  Bound  16  QAM 
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POWER-POWER  SCHEME 
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Fig.  13  Power-Power  Cross-Pol  Interference  Canceler,  Chernoff  Bound  64  QAM 
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P(symbol  error) 


Fig.  15  Power-Power  Cross-Pol  Interference  Canceler,  GQR  calculation,  16  QAM 
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POWER-POWER  SCHEME 


Fig.  16  Power-Power  Cross-Pol  Interference  Canceier,  GQR  calculation.  64  QAM 
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POWER-POWER  SCHEME 
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Fig.  18  Power-Power  Cross-Pol  Interference  Canceler.  Chernoff  Bound  and  GQR 

calculation  comparison,  64  QAM 
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POWER -POWER  SCHEME 


SNR  dB 


Fig.  19  Power-Power  Cross-Pol  Interference  Canceler,  effect  of  increasing  of 
moments  on  GQR  calculation  results.  16  QAM 
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POWER -POWER  SCHEME 


Fig.  20  Power-Power  Cross-Pol  Interference  Canceler,  effect  of  increasing  of 
moments  on  GQR  calculation  results.  64  QAM 
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Fig.  21  Performance  Comparison  of  Power-Power  with  LMS  cancelers,  GOR 
calculation,  16  QAM,  with  amplitude  compensation,  ri  =  r2  =  — 10  dB. 
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Fig.  22  Performance  Comparison  of  Power-Power  with  LMS  cancelers.  GOR 
calculation,  16  QAM,  with  amplitude  compensation,  rx  =  r2  =  -15  dB. 
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Fig.  24  Performance  Comparison  of  Power-Power  with  LMS  cancelers,  GQR 
calculation,  64  QAM.  with  amplitude  compensation,  t-j  =  r2  =  —15  dB. 
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Fig.  25  Performance  Comparison  of  LMS,  Diagonalizer  and  Power-Power  cancelers, 
Chernoff  Bound  .  16'  QAM.  with  amplitude  compensation,  r,  =  r2  =  -10  dB. 
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COMPARISON  OF  LMS 

DIAGONAUZER  AND  POWER-POWER  SCHEMES 


Fie  °6  Performance  Comparison  of  LMS,  Diagonalizer  and  Power-Power  cancelers 
ChernofF  Bound  .  16  QAM.  with  amplitude  compensation,  r,  =  r2  -  -15  d£J. 
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Appendix  D 


Performance  Comparison  of  Three  Bootstrapped  Cross-Pol  Cancelers  for 

M-ary  QAM  Signals 

Abdulkadir  Ding  and  Yeheskel  Bar- Ness 


Abstract 

M-QAM  dual-polarized  transmission  became  an  important  method  for  frequency 
re-use,  particularly  in  microwave  radio  communication.  However,  the  orthogonally 
polarized  waves  suffered  degradation  due  to  cross  polarization  interference. 

Different  canceler  structures  were  proposed  to  mitigate  the  effect  of  cross-polarization. 
Among  these  are  the  diagonalizer  and  the  LMS  canceler.  The  bootstrapped  algo¬ 
rithms  have  been  suggested  in  the  past  for  different  applications  such  as:  satellite 
dual-polarized  communication,  tactical  communication  and  QAM  microwave  radio, 
as  well  as  tactical  communication.  Nevertheless,  no  attempt  has  been  made  yet  to 
quantify  these  cancelers’  probability  of  error.  These  issues  will  be  addressed  in  this 
appendix  and  will  show  that  the  power-power  structure  of  the  bootstrapped  cross 
polarization  always  outperforms  the  other  cancelers. 
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1  Introduction 


In  microwave  radio  communication  networks,  the  transmission  capacity  can  be 
doubled  by  using  orthogonally  polarized  QAM  carriers.  The  orthogonally  polarized 
waves  can  suffer  degradation  due  to  carrier-to-cross  polarization  interference  (C/XPI). 
Particularly  during  multipath  fading,  such  degradation  could  become  intolerable. 

Many  methods  have  been  proposed  to  cancel  the  XPI.  Among  these  are  the  diago- 
nalizer  [1]  and  the  least  mean  square  (LMS)  cross-pol  canceler  proposed  by  Kavehrad 
[2].  In  his  paper,  Kavehrad  compares  the  error  performance  of  these  two  cancelers 
and  concludes  that  the  LMS  algorithm  is  substantially  better  than  the  diagonalizer. 

Still  another  method  for  XPI  is  termed  bootstrapped  algorithm.  It  is  important 
to  note  that  the  bootstrapped  structure  requires  no  reference  signal  nor  any  of  the 
decision  feedback  methods  and  hence,  it  can  be  classified  as  a  blind  canceler;  a  distinct 
important  feature. 

The  bootstrapped  structures  have  been  suggested  in  the  past  for  different  appli¬ 
cations,  such  as  in  dual- polarized  satellite  communication  [3],  QAM  microwave  radio 
communication  [4]  and  in  tactical  communication  [5].  The  error  performance  of  one 
scheme  of  bootstrapped  algorithms  termed  power-power,  was  presented  in  [6]  and 
compared  with  that  of  LMS  and  diagonalizer.  In  this  appendix,  we  intend  to  extend 
the  performance  analysis  to  the  other  structures  of  the  bootst  rapped  blind  canceler 
(BXPC)  algorithms  for  M-ary  QAM  systems  and  compare  the  performance  of  these 
structures  with  each  other. 

In  this  study,  we  derive  and  compare  the  average  probability  of  error  of  the  BXPC 
as  a  function  of  its  input  signal-to-noise  ratio  for  three  different  structures  of  this 
canceler.  After  this  introduction  we  present  the  mathematical  model  of  the  dual 
polarized  channel  in  section  II.  The  different  structures  of  the  BXPC  is  described  in 
section  III.  In  section  IV,  a  summary  of  the  performance  analysis  of  the  BXPC  for 
dual  polarized  M-arv  QAM  system  over  non-dispersive  fading  channel  is  presented. 
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In  section  V,  the  results  of  these  analyses  are  shown  and  compared.  Also  included 
are  the  results  of  the  comparison  of  the  performance  of  BXPC  with  that  of  the  other 
cancelers. 

2  M-ary  QAM  Dual-Channel 

The  model  for  such  a  channel  has  been  well  presented  in  [1,2].  Two  orthogonal  M- 
ary  QAM  bandpass  signals  with  the  same  bandwidth  and  the  same  center  frequency 
can  be  presented  as 

Si(t)  =  Re{si{t)exp{j2-fct)}  (1) 

where  i?e{-}  stands  for  the  real  part,  fc  denotes  the  carrier  frequency  and  $,•($),*  = 
1,2  is  the  complex  envelope  of  each  of  the  orthogonal  signals,  respectively.  This 
complex  envelope  can  be  expressed  as  s,(t)  =  Ikh(t  —  kT )  ,  where  Ik  is  a  complex 

information  symbol  which  takes  on  one  of  M  different  statistically  independent  and 
equiprobable  complex  values.  The  effect  of  the  channel  is  given  by  x(t)  =  As(t)+n(t), 
where  A  is  the  dual-channel  cross  coupling  matrix,  whose  elements  a,j,  i,j  —  1,2 
are  complex  valued  constants  that  denote  the  channels  co-polarization  and  cross- 
polarization  responses,  s(t)  =  [«i(<)i  sz(0]r  and  **(*)  =  [ni(0»  n2(0]T  is  a  complex  zero 
mean  Gaussian  noise  vector. 

The  received  signals  which  are  sampled  after  matched  filters,  are  denoted  by 
xi(n)  =  au/i(n)  -f  aul2(n)  +  ni{n), 

r2(n)  =  a^I^n)  +  a22I2{n)  +  n2(n).  (2) 

where  x^n)  and  x2(n)  are  the  sampled  received  signals  at  the  output  of  the  first  and 
second  channels  respectively.  A(n)  and  ni(n)  are  the  corresponding  signals  and  noises 
at  these  outputs.  Also  n-i(n)  and  r?2(n)  are  assumed  independent  samples  of  the  zero 
mean  complex  Gaussian  with  £{|n,(n)|2}  =  2 <r2,i  =  1.2  . 
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3  The  Bootstrapped  Algorithms 


Three  configurations  of  bootstrapped  structures,  namely,  power-power,  correlation- 
correlation  and  power- correlation,  depicted  in  Figs.  1-3  were  partially  reported  in  the 
open  literature  [3,4,5]  .  Each  configuration  consists  of  two  cross  coupled  interfer¬ 
ence  cancellation  loops.  The  power-power  scheme  is  so  named  because  it  consists 
of  two  control  loops,  each  of  which  tries  to  minimize  the  power  at  its  output.  The 
correlation-  correlation  scheme  similarly  consists  of  two  control  loops,  each  of  which 
tries  to  minimize  the  correlation  between  its  output  and  its  sample  interference.  The 
power-correlation  scheme  is  a  combination  of  the  other  two. 

For  the  power-power  scheme  depicted  in  Fig.  1,  as  well  as  in  the  others,  one 
interference  cancellation  loop  attempts  to  cancel  the  interference  from  the  signal  /2(n) 
into  the  signal  /i(n),  while  the  other  loop  attempts  to  cancel  the  interference  from 
h{n)  into  /2(n).  By  virtue  of  a  discrimination  technique  which  slightly  enhances  the 
signal  component  due  /2(n)  over  that  due  to  Ji(n),  the  first  loop  is  able  to  perform  a 
partial  cancellation  of  the  interference  from  /2(n)  into  I\{n).  This  results  in  a  purer 
sample  of  /i(n)  provided  to  the  second  interference  cancellation  loop,  allowing  that 
loop  to  perform  a  partial  cancellation  in  the  other  direction,  from  h[n)  into  /2(n). 
The  purer  sample  of  /2(n)  is  then  used  by  the  first  loop  to  improve  its  cancellation, 
and  so  the  above  cycle  is  repeated  until  essentially  perfect  interference  cancellation  on 
both  signals  has  been  achieved.  A  similar  argument  shows  that  the  other  two  schemes 
also  lead  to  perfect  interference  cancellation.  Although  it  is  possible  to  consider  more 
general  terms,  we  will  restrict  the  channel  parameters  to 


—  —  r\e  ,  —  —  r2e 

a22  an 


(3) 


where  rj,r2  denote  the  magnitude  of  the  normalized  XPI  constants  and  <t> i,  are 
the  phases  of  these  constants  assumed  to  be  independent  and  uniformly  distributed 
over  [ — 7r ,  tt]. 
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3.1  Power-Power  Scheme 


From  Fig.  1,  one  cam  find  the  output  of  the  canceler 

xi(n)  +  22(n)iui2  ,  .  x2{n)  +  xi(«)u>2i 

2/i(n)  =  — ; - »  y2{n)  =  — - . 

1  —  W12W21  1  —  W12W21 


(4) 


where  x1(n)  and  x2(n)  are  given  in  (2).  The  control  algorithm  simultaneously  min¬ 
imizes  the  output  powers  P\  and  Q 1,  by  searching  for  dE{\yu[p)\2} / dw\2  =  0  and 
d E {\y2d{n)\2} I dw2\  =  0.  This  can  be  performed  by  a  recursive  steepest  descent  al¬ 
gorithm,  provided  that  1  —  wi2w2i  ^  0.  yid(n)  is  the  signal  after  the  discriminator. 
It  can  be  shown  that  wi2  and  w2\  converge  in  the  steady-state  to 


wi2opt  —  +  ei»  ^lopt  —  +  e2-  (5) 

K  a22  K  an 

where  t\  and  e2  are  the  effect  of  the  noise  on  the  steady  state  weights.  They  depend 
on  the  channel  parameters  as  well  as  on  the  signal  and  noise  powers  [7].  Substituting 
(5)  into  (4).  we  get  for  the  first  output 


where 


yi(«)  = 


1_ 

& 


auh(n)[l  -  — — —  +  Ci—  ]  +  h{n)t\a22 

ana22  an 
,  ai2 


+ni(n)  -  n2(n) - 1-  n2(n)ei 

a22 


(6) 


A 


a 12021  aJ2  a2] 

- H - e2  -I-  — ci  —  t\ e2. 

ana22  a22  an 


(7) 


The  co-pol  polarized  signal  at  the  output  of  the  channel  is  given  by  an/i(n),  and 
hence  it  is  reasonable  to  take  yi(n)an  as  an  estimate  of  this  signal  by  compensating 
for  the  attenuation  in  the  co-pol  by  an-  Therefore  /i(n)  =  *^4  35  an  estimate 
of  the  transmitted  signal  7i(n),  and  the  decision  parameter  for  the  first  output  of 
the  canceler  is  defined  as.  Z\(n)  =  /}(n)  —  Ii{n).  We  will  assume  the  in  (7)  is 
negligible  with  respect  to  the  other  terms  of  this  equation,  and  get 

1 


ZAn)  = 


T  /  \  °12  ,  T  I  \  a22  .  tli(n) 

— /i(n)e2 - h  /2(n)e  1 —  H - 

a22  an  an 
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where 


I  <*12 

On  022 


(8) 


a  ^  i  °12a21  ,  0 12  021 

Ay  %  1 - h  - C2  +  — 1\. 

011O22  022  On 

The  probability  of  error  is  given  by  P\(t)  =  P{\Z\{n)\  >  c}  with  c  as  the  half  of  the 
distance  between  any  two  symbols  in  the  corresponding  signal  space.  Note  that  Z\(n ) 
depends  on  the  random  signal  and  noise  variables  A(n)  and  n,(n)  i  =  1,2  and  on  the 
random  variables  d>\  and  o2  through  the  channel  parameter  and  through  the  weight 
perturbation  ei  and  e2-  Therefore,  in  order  to  be  able  to  calculate  the  probability  of 
error,  we  must  find  the  real  and  imaginary  part  of  Z\[n).  Algebraic  manipulation  [7] 
leads  to 


Z\r  —  1\r)\  +  A/1  2  +  Ak-3  +  A/1  4  +  nl/iy5 

+  ”l/}6  +  n2RY?  +  712/18, 

Z\1  =  —  l\p)2  +  A/ll  —  /2/1I4  +  A/I3  —  «l/tl6 

+7*1/1$  ~  n2/jl8  +  ^nYj.  (J) 

where  we  dropped  the  sampling  time  n  for  simplicity,  and  Tm,  m  =  1,2,  ..8  depend 
only  on  the  random  variables  Q\  and  62.  Expressions  for  lm  are  given  in  the  appendix. 

3.2  Correlation-Correlation  Scheme 

The  outputs  y\(n)  and  1/2(72)  from  Fig.  2  are  as  follows 

(/j(n)  =  x,(n)  +  x2(n)u’12, 

y2(n)  =  x2(n)  +  xx(n)w7i-  (10) 

With  this  scheme,  the  algorithm  simultaneously  minimizes  the  correlation  between 
two  outputs.  It  searches  for  d\E {yu(n)yl{n)}\2 / dwn  =  0  and  d|£{y2</(7i)yJ(n)}|2/#W2i  = 
0.  As  in  the  previous  scheme,  it  can  be  shown  that  w\2  and  u>2i  converge  in  the  steady 
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state  to  the  same  values  as  in  (5).  Following  the  same  steps  as  in  the  power- power 
scheme,  we  get  the  decision  parameter 


Z,(n)  =  ]  +  —  f/,(B)aM«, 

a22Qii  On  On  L 

-f-ni(n) -f  n2(n)[ — —  +  ci]|  -  (11) 

022  J 

Algebraic  manipulations  lead  to 

Z\r  =  1\rYc\  +  IiiYa  +  IirYc3  +  hiYc 4  +  tiirYc  s, 

+02flVc6  +  02/5^7, 

Zll  =  —I\rYc2  +  hlYci  —  I2rYc4  +  I21Y&  +  Ul/Fc5. 

—  ^2rYc7  +  ^2  lYcQ.  (12) 

where  again  Yen  m  =  1.2,  ..7  depends  only  on  the  random  variables  <j>\  and  o2- 
Expressions  for  Ycm  are  given  in  the  appendix. 

3.3  Power- Correlation  Scheme 

The  outputs  yi(n)  and  3/2(0)  from  Fig.  3  are  as  follows 

l/l(o)  =  Xi(o)(l  +  I012l02l)  +  ^2(0)10,2, 

1/2(0)  =  x2(o)  +  X!(n)u;2i.  (13) 

The  control  algorithm  simultaneously  minimizes  the  output  power  £{|i/i,i(«)|2}  and 
the  square  magnitude  of  the  correlation  of  output  j/2<i(o)  with  1/1(0).  It  searches  for 
dE{\yu(n)\2}ldw\2  =  0  and  d|£{t/2d(o)yj(n)}|2/du>2i  =  0-  If  can  be  shown  that  U'n 
and  u'21  converge  in  the  steady  state  to 

aU  .  fl21  ,  f>A\ 

a’>2opt  -  M  _  auo^l  +  e3,  u-21opt  -  +  «<•  (I4) 

aj20i|J  11 

Unlike  the  other  two  schemes  of  bootstrapped  cancelers.  the  power- correlator  scheme 
is  not  symmetrical;  its  outputs  and  hence,  the  decision  parameters  for  each  output  are 
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different.  From  (14)  with  the  substitution  of  u>120pt  and  u>2iopt  *n  (13),  we  obtain 


Vi  (n)  —  /i(n)an[l - -C4  +  €3^4]  +  h(n)a22- 

a22At 

f  (Ql2\2^  ,  L  ,  a12i  I  /  .r,  .  Ol2fl21  1 

[— (  )  — C4  +  &e3  -f  £364 — ]  -f  ni(n)[l  H - — 

a22  U22  022^11  k 

°2i  ai2  e2  ,  ,  u-ai2  ,  , 

- e3 - r  +  €3£4j  +  n2(n)[-  {-CiJ, 

an  a22  fc  a22« 

y2(n)  =  /i(n)e4<2n  +  /2(n)a22[l - *2  4-  £4— ~] 

<2\la22  022 

+n2(n)  -f-  ni(n)[— —  +  e4]. 

an 


(15) 


and  the  corresponding  decision  parameters 


Zi(  n)  =-/,(n)-^e4+  1 


0.22k  ank 


a22 


+e3/:2]  +  nx(n)[l  -  — e3fc  -  — e4] 
an  a22 

+n2(n)[-  —  +  Arc3]l , 
a22  J 


Z2(n)  =  — 

a22 


a.22 

/.(»)<■,.«  +  /*(")[-—  +  £<i»] 

fljl«22  U22 


+n2(n)  +  nj(n)[— —  +  e4]  . 

au 


(16) 


where  k  =  1  -  .  The  real  and  imaginary  parts  of  Zi(n)  and  Z2(n)  are  given 

by 


=  IirYii  +  /1/V12  +  I2R.Y13  +  hi^u  +  ti\rYi5 
+nj/Vi6  +  nifiYn  +  nuY\%, 

Z\i  =  ~UrY\2  +  I\iY\\  —  I2rYu  +  hiY\z  —  tiirYk, 

+  ^1/^15  —  ™2rY\s  +  n2iYi7.  (17) 


Z2  R 


I\R^  21  +  fl/F  22  +  /2/jl  23  +  hl^U  +  ^1/1^25 


+  Ul/1  26  +  n2RYi7, 
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Zll  =  —I\pY22  +  III ^21  —  IibYiA  +  hfYiZ  ~  ^1/2^26 

+ni/V2S  +  ^2/^27*  (18) 

where  as  before  Tu,  /  =  1,2,  ..8  and  V^m,  m  =  1,2,  ..7  [7]  depends  only  on  the 
random  variables  <p\  and  <p 2. 

4  Performance  Analysis 

Using  the  decision  parameter  of  equation  (9),  (12),  (17)  and  (18)  for  the  three 
structures,  respectively,  we  have  for  the  average  symbol  error  probability 


file)  =  i[l  -  >  c)  +  P(|Z„|  >  c)}.  (19) 

The  least  upper  bound  on  P{\Z\r\  >  c),  called  the  Chernoff  bound  [8],  would  then 
be  given  by 


Pi(e) 

exp 


-3  (SNR) _ 1 _ 

.  2 (M  —  1)  (SA R)Ui(<j>\,</>2)  +  ^i{4>i,<f>2) 


d<t>id.<p2. 


(20) 


where,  SNR  =  [8],  and  t/i(<?>i,<p2)  and  ^(^1,^2),  *=1,2  differ  for  different 

schemes  [7]. 


=  y?  +  t22  +  t32  +  r42, 

iWi,fc)  =  K2  +  u62  +  K?  +  Yl  (21) 


where  Vm,  m  =  1,2.  ..8  is  defined  in  (25). 
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(22) 


The  correlator-correlator  scheme 

uMuh)  =  13  +  13  +  13  +  13 

=  13  +  13  +  13 

where  ym,  m  =  1,2,  ..7  is  defined  in  (27). 

Due  to  the  symmetric  structure  of  the  power-power  and  correlator-cor  elator 
schemes,  the  error  probabilities  at  both  outputs  of  each  corresponding  scheme  are 
the  same  for  each  structure. 

The  power-correlator  scheme  for  output- 1 

l\(hM  =  i3  +  lS  +  »3  +  l3 

1,*)  =  I3  +  I3  +  I3  +  I3  (23) 

where  }'k,  1=  1,2,  ..8  is  defined  in  [7], 

For  output-2 

tWi.fc)  =  13  +  13  +  13  +  13 

=  13  +  13  +  13  (24) 

where  Vjm  m  =  1,2,  ..7  is  defined  in  [7). 

5  Results  and  Conclusion 

The  Chernoff  upper  bound  (20)  on  the  average  probability  of  error  as  a  function 
of  signal-to-noise  ratio  (SNR)  is  calculated  for  various  cross  coupling  constants  for  16 
and  64  QAM  signals  and  for  the  three  different  structures  of  the  blind  bootstrapped 
cross  polarization  canceler. 

The  performance  of  these  three  structures  is  depicted  in  Fig.  4.  5,  6  and  7  for  the 
16  QAM  with  r=  -15  dB  and  -10  dB.  The  bounds  are  higher  for  64  QAxM  indicating 
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a  possibility  of  higher  error  rates  for  the  same  SNR.  In  Fig.  8,  we  compare  the  per¬ 
formances  of  these  three  structures  of  BXPC  with  that  of  the  LMS  cross  polarization 
canceler. 

From  these  figures,  we  conclude  that  the  power-power  scheme  outperforms  the 
correlator-correlator  and  power-correlator  schemes,  particularly,  when  the  cross  cou¬ 
pling  is  high  ,  such  as  -10  dB.  Also  noticeable  is  the  fact  that  the  performance  at 
the  two  outputs  of  the  power-correlator  scheme  are  not  the  same.  The  performance 
of  one  output  is  the  same  as  that  of  the  power-power  scheme  and  the  other  output 
performance  is  close  to  the  performance  of  the  correlator-correlator  structure.  In  Fig. 
8,  it  is  clearly  shown  that  the  power-power  scheme  performs  better  than  the  others, 
while  LMS  performs  better  than  that  of  the  correlator-correlator  and  that  of  output-2 
of  the  power- correlator  scheme. 

Appendix 


The  Power-Power  Scheme 


Y\ 

Yz 

Y4 

n 

Y7 

Ys 


1\rZdr  -r  KjZdi  _  KiZqr  -  KrZdi 

I Zd?  '  IW 

<*22  LirZdR  T  tuZpi 

an  |ZDj2 

<*22  c \rZqi  -  e \iZqr 
<*u  |  ZD|2 

Zdr  ...  _  Zpj 
Ou\Zd\2'  ‘_a„|Zol2’ 

(£i R  ~  rjcoso-i  )Zpr  +  (ei/  -  r\sin0\  )Zpj 
an\Zp\2 

(r15<nc>i  ~  j)Zpr  +  (ti R  -  r^cosQ]  )Zpj 
au\Zp\2 


Zp  =  ZpR+jZp[,  I\=I\R+jI\p 

1’  =  Ifi  +  jYp  t\=ClR+J(U 

«2  =  «2/?i-Jf2< 


(25) 


(26) 
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where 


Zq  % 
K  k 


012^21  ,  <*12  .  <*21 

1 - +  — c2  +  — ci, 

<*n<*22  <*22  ®n 

<*12  T  /  A  <*21 

— e2,  V  =  — Cl. 

<*22  <*n 


The  Correlator-Correlator  Scheme 


and 


Yei  =  Vr-  rir2cos{di  +  <p2), 


Yc2  =  —[Vi  -  rir2sin(c>\  +  <£2)], 

t/  <*22  <*22  y  1 

*c3  =  - ClR,  Jc4  = - Cl/,  •*  c5  =  - , 

<*11  <*11  <*11 

Yc6  =  - (Clfi  “  riCOSOij, 

<*11 

Yc 7  = - [ci /  - 

<*u 


(27) 


Cl 


C2 


Zd 


*11 


r\e?*1  4-  r2e  ^  —  r2r2eJ(2<*’1+“^ 


— rir^e-7^1 


.JE{|n(n)|1}f;{|/1(Tl)|I}(«ll  -  Su) 


1  2 
^rfl22 

-r\r2e 


^ie 

i<h\ 


-j<t>  i  +  r2e>^  -  r1r^ej(^,+2^) 
.£{|n(n)|2}£{|/2(n)|2}(^2-<522) 


where  8X]  =  £^{ /  *s  discrimination  constant  which  is  the  ratio  of  the  mean 
square  of  j  th  output  signal  at  the  output  of  the  i  th  discriminator  to  the  j  th  signal, 
and  yjd{n)  is  the  signal  after  the  discriminator. 
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signals' 

discrim. 


L 


input  #2: 

V2(t)=c#s(t)*n(t) 


Fig.  1  Power- Power  Cross-Polarization  Canceler 
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Fig.  2  Power-Correlator  Cross- Polarization  Canceler 
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input  #1 : 

Vi(t)*s(t)»bu(t) 


1  I2 

BK5B 

signals' 

1  1 

discrim. 

1 

input  #2: 

v2(t)=c-s(t)*n(t) 


Fig.  3  Correlator- Correlator  Cross-Polarization  Canceler 
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P(symbol  error) 


POWER-POWER  SCHEME 


Fig  4.  Power-Power  Cross-Pol  Canceler,  Cheraoff  Bound  comparison  16  QAM  vs. 

64  QAM 
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CORRELATOR-CORRELATOR  SCHEME 


Fig  5.  Correlator-Correlator  Cross-Pol  Canceler.  Chernoff  Bound  comparison  16 

QAM  vs.  64  QAM 


186 


P(symfeot  error) 


POWER-CORRELATOR  OUTPUT- : 


Fig  6.  Power- Correlator  Cross-Pol  Canceler  output-1.  ChernofF  Bound  comparison 

16  QAM  vs.  64  QAM 
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3  10  IS  20  25  SO  35 

SNR  dB 


Fig  7.  Power-Correlator  Cross-Pol  Canceler  output-2.  Chernoff  Bound  comparison 

16  QAM  vs.  64  QAM 
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P(symbo!  error) 


COMPARISON  OF  THE  CROSS-POL 
CANCELERS  WITH  LMS  CANCELER 


16  20  24  28  32  36 

SNR  dB 


Fig  8.  Comparison  of  the  Cross-poi  Cancelers  with  LMS  Canceler 
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Appendix  E 


Bootstrap:  A  Fast  Blind  Adaptive  Signal  Separator 

Abdulkadir  Ding  and  Yeheskel  Bar-Ness 

Abstract 

In  this  report,  we  propose  a  new  fast  multidimensional  adaptive  algorithm  for 
multi  signal  separation.  The  method  is  essentially  based  on  multi-power-inversion 
schemes  [1].  It  separates  multi  uncorrelated  signals  imposed  on  each  other.  The  two 
dimensional  version  of  this  adaptive  algorithm,  named  bootstrapped  canceler,  has 
been  applied  to  digital  communication  to  mitigate  the  effect  of  cross-polarization  in 
dual  polarized  M-ary  QAM  signals  [3].  It  has  been  shown  that  in  previous  appendices 
that  the  power-power  bootstrapped  algorithm  performs  better  than  the  least  mean 
square  (LMS)  algorithm  in  separating  the  two  uncorrelated  signals  [5].  In  this  ap¬ 
pendix,  we  propose  a  multi  dimensional  nonlinear  learning  algorithm  which  is  based 
on  minimization  of  output  signal  correlations  and  we  also  investigate  the  learning 
process  of  this  bootstrapped  algorithm  compared  with  that  of  the  LMS  algorithm 
for  different  eigenvalue  spreads.  It  has  been  found  from  the  computer  simulations 
that  the  bootstrapped  algorithm  converges  very  rapidly  with  respect  to  the  LMS  al¬ 
gorithm.  It  is  important  to  notice  from  the  computer  simulations  that  the  learning 
process  of  the  bootstrapped  algorithm  is  almost  independent  of  the  eigenvalue  spread. 
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1  Introduction 


Multi  channel  interference  can  be  a  performance  limiting  factor  in  signal  process¬ 
ing  systems.  Removal  of  these  interferences  can  be  accomplished  by  use  of  adaptive 
signal  separators.  The  bootstrapped  algorithm,  which  does  not  require  a  training 
sequence,  has  been  proposed  for  two  dimensional  interference  cancellation  with  dif¬ 
ferent  adaptive  learning  schemes  [1].  Several  adaptive  signal  separators  which  require 
a  training  sequence  have  been  proposed  in  the  literature  applied  to  communication 
systems  [2]. 

Our  objective  in  this  report  is  to  extend  the  bootstrapped  algorithm  to  multi 
dimensional  signal  separation  applications  and  to  investigate  its  convergence  for  dif¬ 
ferent  eigenvalue  spreads. 

In  section  II.  the  description  of  the  channel  model  is  given.  We  discuss  the  adap¬ 
tive  signal  separators  in  section  III.  In  section  IV  the  convergence  of  LMS  and  boot¬ 
strapped  algorithms  are  com  pared  by  a  computer  simulation.  The  results  of  the  con¬ 
vergence  comparisons  are  presented  in  section  V.  Finally,  the  conclusion  is  presented 
in  section  VI. 

2  Channel  Model  and  Problem  Statement 

In  matrix  notation,  a  discrete  time  model  of  a  M-dimensional  interference  channel 
is  given  by 


x(n)  =  AI(n)  +  n(n)  (1) 

where  A  is  the  channel  matrix.  I  is  the  information  vector  assumed  to  be  an  indepen¬ 
dent  and  identically  distributed  sequence  and  n  is  a  white  Gaussian  noise  sequence. 


192 


and  x  is  the  received  signal  vectors  respectively. 

’flu  •••  aiM  1  (■  /i(n)  f  m(») 

a  =  021  ;;;  “2M  ,  n„)  =  h(n)  »(»)  =  ni(n) 

.  AMI  ■  •  •  olmm  J  L  I\i{n)  J  n\i(n) 


(2) 


The  channel  is  assumed  to  be  slowly  time  varying  and  non-dispersive.  Hence, 
the  channel  interference  coefficients  aXJ  i,j  =  1,2 ..M  are  assumed  to  vary  slowly 
with  respect  to  the  signal  rate  and  assumed  to  be  less  than  one  while  the  diagonal 
coefficients  an  i  =  1,2.. M  are  assumed  to  be  close  to  one. 

Our  objective  is  to  find  a  multi  dimensional  bootstrapped  adaptive  algorithm 
structure  that  will  diagonalize  the  channel  matrix  A  (that  is  to  find  the  inverse  of  A) 
without  requiring  a  training  sequence  and  demonstrate  its  convergence  with  that  of 
an  LMS  algorithm. 


3  LMS  and  Bootstrapped  Adaptive  Signal  Sep¬ 
arator 

3.1  Multidimensional  LMS  Adaptive  Signal  Separator 

The  traditional  LMS  algorithm  which  minimizes  the  error  E{e]  +  el  +  at  the 
output  of  the  separator  (Fig.  1)  can  be  used  as  a  multi  dimensional  signal  separator 
and  solution  of  the  optimum  weights  are  given  by 

Wopl  =  R^P  (3) 

and 

i(n)  =  Wj,,x(n)  (4) 
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where  using  (1)  in  (5) 


R  =  AR/At  +  R* 


(6) 


where 

...  o 

0 

The  recursive  weight  updating  algorithm  to  search  for  the  optimum  weights  is 
given  by, 


r£f/?}  o- 

0  ' 

R/  = 

•""I 

ST 

o  •• 

0 

Rn  = 

o 

EVli)  . 

tOi;(rc  +  l)  =  Wij{n)  -  fiei(n)xj(n),  j  =  1.2..A/}^1 

e«(n)  =  yi{n)  -  /<(n)  (8) 

where  Ii(n)  is  the  reference  signal. 

3.2  Multidimensional  Bootstrapped  Signal  Separator 

From  Fig.  2,  it  can  be  easily  shown  that  the  output  of  the  bootstrapped  algorithm 
is  given  by; 

y(n)  =  Wfi1x(n)  =  Wfi1[AI(n)  +  n(n)]  (9) 

where, 

1  ~WBU  -U-'BlM 

—WB21  1 

~wBMl  -WBM2  ■  1 

provided  that  the  determinant  of  Wg  is  not  zero,  we  suggest  the  following  boot¬ 
strapped  recursive  algorithm  that  provides  w gopt  =  A-1  in  a  no  noise  condition. 

Our  approach  is  to  minimize  the  correlations  at  the  outputs,  simultaneously.  For 
simplicity,  we  show  the  optimal  weights  for  two  dimensional  signal  separation. 
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(11) 


Using  (1)  in  (9),  one  can  easily  show  that, 

!».(»)  =  |[A/,(n)  +  B1M) 

Sto(n)  =  i[C/,(n)  +  Dh(n)\ 

where 

A  —  011+021^512?  B  =  Oj2  +  02210512?  C  =  021  +  OnlOB21 

D  —  022  +  Oi2tOj321?  A  —  1  —  10512*0521  (12) 

3.3  Cube  Nonlinearity  in  Controlling  Bootstrapped  Algo¬ 
rithm 

The  recursive  algorithm  to  search  for  the  optimum  weights  is  given  by, 

{ioBti(n  +  1)  =  WBij(n)  -  /i/(j/,(n))yj(n),  j  =  1,2..A/  1  #  j}^  (13) 

where  f(y)  =  y3  is  an  odd  nonlinear  function. 

To  simplify  the  analysis,  the  optimum  weights  are  found  in  a  no  noise  environment. 
By  taking  the  expected  value  denoted  by  £’{(.)}  of  both  sides  of  (13),  and  using  (11) 
in  (13),  we  can  write, 

£{y?(n)y2(n)}  =  E{±[ll(n)B3  +  3h(n)I22(n)AB2  + 

ZI*(n)I2(n)A2B  +  /13(n)/l3][/1(n)C  +  I2(n)D]  (14) 

E{Ii{n)Ij(n)}  =  S(i  -  j),  £{J,(n)}  =  0  (15) 

Using  (15)  in  (14),  and  assuming  £{/i2(n)}  =  E{I2(ti )},  and  E{I*{n)}  =  £{/^(n)}. 

£{»?(»)»(«)}  =  -i;[3£{/,2(n)}£{/J(n)}B>l(BC  +  AD)  +  £{/,4(n)}(.43C  +  B3D] 
similarly 

£{»5(n)»,(")}  =  ^[3£{/f(n)}£(/|(n)}DC(BC  +  AD)  +  £(/,4(n))(.4C3  +  BD3) 

(16) 
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The  optimum  weight  vector  w Bopt  for  the  bootstrapped  algorithm,  is  the  solution  of 
the  nonlinear  equations  in  (16).  For  i.i.d  binary  data  .  /;(n)  =  ±1,  from  (16),  we  can 
write, 

£{  !/?(n)yj(n)}  =  ^j[(3fl!+/i!MC  +  (BJ  +  34!)BD] 
similarly 

E{yl(n)y  i(n)}  =  i|(3H2  +  C2)AC  +  (D1  +  3C2)BB]  (17) 

The  desired  optimum  solution  requires  A  =  B  =  C  =  D^  0,  simultaneously  and 
A  ^  0.  Two  equilibrium  solutions  that  make  the  equations  in  (16)  equal  to  zero  are 
B  =  C  =  0otA  =  D  =  0.  These  optimum  solutions  are,  wBop(1  =  — 
and  w Bopt2  —  —  The  required  optimum  solution  which  provides  a  stable 

equilibrium  point  is  WBopti  .  The  detail  steady  state  analysis  of  the  solution  of  the 
optimum  weights  can  be  found  in  [1]. 

3.4  Use  of  Supervised  (reference)  Signal  in  Controlling  Boot¬ 
strapped  Algorithm 

This  analysis  is  done  in  order  to  compare  the  learning  process  of  the  least  mean 
square  (LMS)  algorithm  which  uses  a  supervised  signal  with  that  of  the  bootstrapped 
algorithm  .  The  weight  updating  algorithm  is  given  by; 


+  !)  =  Wflt,(n)-/ie.(%(4  J  =  1,2..M 

e,  =  yi{n)-Ii(n)  (18) 

where  7,(n)  is  the  reference  signal. 

By  taking  the  expected  value  of  the  gradient  and  using  (11)  and  (12)  in  (18),  we 
get 
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similarly 


£{e2(n)9l(n)}  =  ij[£{/J(n)}AC  +  E{I*(n)}B(D  -  A)]  (19) 

Similarly,  for  the  optimum  wboph  solution  to  exist  A  —  B  =  C  —  0,  simul¬ 

taneously  and  A  /  0  required.  At  the  required  equilibrium  point  B  =  C  =  0,  the 
optimum  weight  is  wSoptl  =  -[f£,  ^-j. 

4  Simulation 


The  inputs  to  the  channel  are  assumed  to  be  binary  ±  1.  The  two  and  three 
dimensional  interference  channels  are  modeled  by  A  matrix  (2).  The  outputs  from 
the  channel  are  corrupted  by  additive  Gaussian  noise  with  SNR=40  dB.  The  received 
signals  are  then  input  to  the  LMS  in  one  hand  and  bootstrapped  adaptive  signal 
separators  in  the  other  hand 

The  results  for  500  Monte  Carlo  runs  are  given  for  a  two  dimensional  interfer¬ 
ence  channel  for  different  A  matrix  coefficients  essentially  for  different  eigenvalue 
spreads.  We  take  signal  attenuations  a„  =  1  and  interference  constants  atJ  to 
be  all  the  same  constant  value.  By  setting  all  the  weights  initially  to  zero,  and 
providing  a  constraint  xi-g,j  <  1  to  search  for  the  optimum  WBopti  in  the  boot¬ 
strapped  blind  separator,  the  learning  processes  of  the  LMS  algorithm  and  the  boot¬ 
strapped  algorithm  are  compared  for  different  signal-to-interference  ratio,  (SIR  = 

a?j£{/|(n)}+..+a?,£{/f(n)}  ,  .  ,  . 

<>„£{/»}  1  l^J' 

In  a  two  dimensional  interference  case  ,  the  eigenvalue  spread  (Amo*)  Gf  the  (2x2) 

input  signal  correlation  matrix  R  in  (5)  for  an  =  a22  =  1  and  interference  constants 

al2  =  a2 1  ,  £{/]2(n)}  =  E{Ij(n)}  =  1  and  zero  noise  power  are  given  in  Table  1. 
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SIR 

<*12 

^mai 

^min 

^mai  /  ^min 

20 

0.1 

1.21 

0.81 

1.494 

0.826 

13.97 

0.2 

1.44 

0.64 

2.25 

0.694 

10.46 

0.3 

1.69 

0.49 

3.449 

0.592 

7.96 

0.4 

1.96 

0.36 

5.444 

0.51 

6.02 

0.5 

2.25 

0.25 

9.0 

0.44 

4.42 

0.6 

2.56 

0.16 

16 

0.391 

3.01 

0.7 

2.89 

0.09 

32.11 

0.346 

1.94 

0.8 

3.24 

0.04 

81.0 

0.309 

0.91 

0.9 

3.61 

0.01 

361 

0.277 

0 

1.0 

4.0 

0.0 

oc 

0.255 

Table  1. 


5  Results 

In  this  section,  we  present  the  results  of  the  computer  simulations  for  different  SIR 

and  convergence  constants  pL.  We  have  done  the  experiment  in  two  parts.  In  the  first 

part,  we  compared  the  learning  processes  of  LMS  in  (3)  and  bootstrapped  algorithms 

in  (18)  for  the  separation  of  two  dimensional  signal  sources  by  using  the  reference 

signals.  The  results  of  the  experiment  are  given  in  Figs.  3  and  4,  for  different  SIR  — 
2 

10/o^(^-)  (from  Table  1)  and  for  chosen  convergence  constants  n  The  convergence 
constants  for  these  two  algorithms  are  chosen  to  be  less  than  their  maximum  values. 
In  Fig.  5,  the  learning  process  of  bootstrapped  algorithms  is  depicted  for  SIR=7.96 
dB  with  different  convergence  constants. 

In  the  second  part  of  the  experiment,  we  show  the  comparison  of  the  learning 
processes  of  bootstrapped  blind  separation  algorithm  in  (13)  with  respect  to  the 
same  updating  algorithm  by  use  of  the  reference  signal  in  (18)  for  the  three  signal 
separation  in  Fig.  6. 
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6  Conclusion 


In  this  report,  it  is  shown  experimentally  that  the  learning  process  of  the  boot¬ 
strapped  signal  separator  in  Fig.  1  with  fewer  of  weights  is  faster  than  the  LMS 
algorithm  in  Fig.  2.  This  can  be  easily  seen  from  Figs.  3  and  4  especially  at  high 
SIR.  At  the  steady  state,  the  residue  power  with  blind  separation  (using  cube  non¬ 
linearity)  is  more  than  with  respect  to  the  use  of  reference  signal  in  the  bootstrapped 
algorithm.  As  the  recursive  weight  updating  algorithm  (13)  is  a  nonlinear  process, 
the  search  for  the  global  optimum  weights  is  essentia!  for  the  multi-dimension  boot¬ 
strapped  blind  separator. 
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h  1 


Fig.  1  Multi-Input/Output  LMS  Signal  Separator  for  3  input/output 
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w2j(n  +  1)  =  w2j(n)  -  nf(y2(n))yj{n ) 
j— 1*3 


t03,(n  +  1)  a  uty(n)  -  Mf(y3(n))yj(n) 

j~l*2 


Fig.  2  Multi- Input /Output  Backward/Backward  Bootstrapped  Signal  Separator 
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Fig.  4  Bootstrapped  Signal  Separator  with  different  eigenvalue  spreads  (cross 

coupling) 


204 


RESIDUE  ERROR  POWER.  dB 


LMS  Adaptive  Signal  Seperator 


Fig.  5  Bootstrapped  Signal  Separator  for  Different  convergence  constants  with  fixed 

(cross  coupling) 
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Appendix  F 


Convergence  and  Performance  Comparison  of  Three  Different  Structures 
of  Bootstrap  Blind  Adaptive  Algorithm  for  Multi-signal  Co-Channel 

Separation 

Abdulkadir  Ding  and  Yeheskel  Bar-Ness 


Abstract 

Multi-signal  co-channel  interferences  can  cause  major  limitations  on  the  perfor¬ 
mance  of  communication  systems.  The  multidimensional  least  mean  square  (LMS) 
algorithm  can  be  used  to  cancel  these  interferences.  However,  such  an  algorithm 
requires  the  availability  of  the  reference  (supervisory)  inputs.  In  some  applications, 
there  is  a  need  for  signal  separation  rather  than  interference  cancellation.  That  is,  the 
system  must  contain  more  than  a  single  output,  (each  delivers  one  signal,)  as  clean 
as  possible  from  other  signals  (interferences). 

In  this  appendix,  we  intend  to  extend  the  previously  reported  three  structures  of 
bootstrap  blind  signal  separators  to  the  multi-signal  co-channel  case,  study  their  per¬ 
formances,  their  depth  of  cancellations,  speed  of  convergences  and  their  dependency 
on  eigenvalue  spreads.  We  also  present  simulation  results  comparing  the  performance 
of  these  three  structures  for  two  and  three  signals  separation  under  white  Gaussian 
noise  environment  and  for  different  signal  to  interference  ratios.  Particularly,  it  is 
shown  analytically,  as  well  as  experimentally  (by  simulation),  that  the  use  of  equal¬ 
ization  (automatic  gain  control  (AGC))  at  the  output  of  these  structures  improves 
the  depth  of  interference  cancellation  dramatically. 
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1  Introduction 


Although  one  can  design  the  LMS  algorithm  to  perform  signal  separation,  the  com¬ 
plexity  of  such  an  approach  increases  rapidly  as  the  number  of  signals  to  be  separated 
increases.  Using  the  bootstrap  algorithm,  one  can  perform  such  separation  without 
the  need  for  reference  signals  in  a  form  of  training  sequences,  decision  feedbacks, 
or  other  methods.  Three  different  structures  proposed  in  [1],  termed  power-power, 
correlator-correlator  and  power-correlator,  have  also  been  reported  in  the  open  liter¬ 
ature  [2].  Its  separation  capability  for  two  signals  was  shown  and  simulation  results 
using  the  power-power  structure  were  included.  Successful  application  of  the  power- 
correlator  structure  for  satellite  communication  was  reported  in  [3-4].  The  use  of  the 
power-power  structure  in  cross-polarization  cancellation  for  M-arv  QAM  was  reported 
in  [5].  Error  probability  performance  was  estimated  and  compared  to  that  of  LMS 
and  other  cancelers.  It  was  proven  analytically  and  demonstrated  by  simulation  and 
in  practical  hardware  implementation  that  for  the  bootstrap  algorithms  to  converge 
to  a  state  of  signal  separation,  there  is  a  need  for  the  inclusion  of  nonlinearity,  termed 
signal  discriminator. 

In  addition  to  being  capable  of  high  blind  signal  separation,  it  was  shown  that 
the  power-power  structure  of  the  bootstrap  algorithm  converges  faster  than  the  LMS 
algorithm  and  is  independent  of  the  eigenvalue  spread  of  the  input  correlation  matrix 
[61- 

In  this  work,  we  investigate  the  convergence  properties  and  performance  of  three 
structures  of  the  bootstrap  blind  algorithm  with  different  eigenvalue  spreads  and 
extend  it  to  multidimensional  signal  separation. 

In  section  II  a  multi-signal  co-channel  description  is  given.  In  section  III,  the 
three  different  structures  of  the  bootstrap  blind  algorithm  are  given.  In  section  IV, 
the  convergence  and  the  steady  state  performance  of  the  three  structures  of  bootstrap 
blind  adaptive  algorithms  are  compared  using  computer  simulations.  The  conclusion 
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is  presented  in  section  V. 


2  Multi-signal  Co- Channel  Model 

In  matrix  notation,  the  discrete  time  model  of  an  M-signal  co-channel  is  given  by 

x(n)  =  AI(n)  +  n(n),  (1) 

where  A  is  the  channel  matrix,  I  is  the  information  vector  assumed  to  be  independent 
and  identically  distributed  sequence,  while  n  is  a  white  Gaussian  noise  and  x  is  the 
received  signal  vectors,  respectively.  The  channel  is  assumed  to  be  slowly  time  varying 
and  non-dispersive.  Hence,  the  channel  matrix  A  can  be  approximated  by  interference 
coefficients  aXj  i  ^  j,  i.j  =  1,2,  ..M,  assumed  to  vary  slowly  with  respect  to  the 
signal  7,(n)  rate  and  to  be  less  than  unity  in  magnitude.  The  diagonal  coefficients 
an  i  =  1,2.. XI  are  assumed  without  loss  of  generality  to  be  unity. 


3  Bootstrap  Blind  Adaptive  Signal  Separators 

3.1  Multidimensional  Power-Power  Scheme 


It  can  easily  be  shown  from  Fig.  1  that  the  output  is  given  by 


y(n)  =  wt  ‘xln)  =  wl  l[Al{n)  +  n(n)] 


where, 


Wi 


1  -W 12 

-U>21  1 


~W\M 
—  W2M 


[  -WM 2  ■  1 


(2) 

(3) 


y,(n) 


,  M  M  x 

f  o.«  +  y;  u'ljgji  +  Y!  wnM-j+i)w{M-j+i)}ai'  ~  anw\nM )  w*) 
j?' 


U  ,  M  U  X 


+nox(n) 


(4) 
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The  first  term  in  (4)  represents  the  desired  signal  at  the  i  th  output,  the  second 
term  is  the  residual  interference  from  all  other  signals,  while  nQj(n)  is  the  resultant 
Gaussian  noise  at  the  output.  A  is  the  determinant  of  the  matrix  Wi  in  (3).  Notice 
that  the  desired  signal  is  somewhat  distorted  and  needs  equalization.  Due  to  the 
complexity  of  the  general  expression,  we  only  write  the  output  for  the  case  of  two 
dimensional  signals  and  no  noise  environment.  Therefore,  using  (1),  (2)  and  (3),  we 
get  for  the  outputs 


</■(")  =  AIi(n)  +  BI7(n)] 

y2(n)  =  I[C/,(n)  +  £>/,(«)]  (5) 

where 

A  =  an  +  a2iU>i2,  B  —  aX2  +  022^12 

C  =  a2i+ajitt>2ij  D  =  a22  +  “12^21 

A  =  1  —  u;i2u>2i  (6) 

Notice  that  the  desired  signal  is  somewhat  distorted  and  needs  equalization. 

A  Recursive  Algorithm  to  Search  for  Optimal  Weights 
A  recursive  algorithm  is  used  to  search  for  optimal  weights  that  result  in  signal  sep¬ 
aration  for  the  three  different  structures  of  bootstrapped  algorithms.  The  algorithm 
simultaneously  minimizes  the  estimates  of  the  output  correlations  f[y,(n)]yj{n)  i,j  = 
1,2,  ..M  1  j,  where  /[.]  is  an  odd  memoryless  nonlinear  transformation.  It  can 
be  shown  that  such  nonlinearity  satisfies  the  need  for  signal  discrimination  and  is 
sufficient  to  make  it  converge  to  a  state  of  signal  separation.  Using  steepest  descent 
recursion,  we  get 

wtj{n  +  1)  =  iy,7(n)  -  nf[yi(n)]yj{n),  i,j  =  1,2.. M  i  /  j.  (7) 
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where  n  is  the  stability  convergence  constant.  In  order  to  have  convergence  in  the 
mean  of  the  weights  t «,j,  we  must  require  £{/[y,(n)]yj(n)}  =  0,  i,  j  =  1, 2,  ..M  i  ^  j. 
In  the  case  of  the  two  dimensioned  signal,  we  must  have 

E{f[yx{n))y2(n)}  =  £{/[y2(n)]yj(n)}  =  0.  (8) 

Using  (4)  in  (7),  with  f[y]  =  y3,  we  get 

£{</?(")!/*(»)}  =  ^(3  E{I\(n)}E{ll(n))BA(BC  +  AD) 
+£{/»}M3C  +  B3D], 

£«(»)».(»)}  =  -i;[3£{/?(n)}£{/|(„)}DC(i3C  +  AD) 

+£'{/t4(Ti)>(^C73  -t-  ST?3].  (9) 

For  the  sake  of  simplicity,  we  take  £{/3(n)}  =  £{/|(n)}  and  E{I*(n)}  =  ^{/jfn)}. 
Furthermore,  for  7,(n),  taking  values  ±1  with  equal  probability,  (8)  becomes 


£{■/?(")»!(")}  =  i[(3B!  +  A!)/lC  +  (BJ+3A2)BD], 

E{  y?(n)y,(n)}  =  -L[(3£>2  +  C2)AC  +  {D‘  +  3C2)eD],  (10) 


For  the  two  equations  in  (9)  to  equal  zero,  it  is  necessary  and  sufficient  to  have 
either  B  =  C  =  0otA  =  D  =  0.  These  conditions  result  in  two  equilibrium  points 


Wopti 


|Q12  Q21 j 
02 2  All 


.022  Oil, 

wopt2  = 

O  12  021 


(11) 


It  can  be  shown  that  woptl  is  a  stable  equilibrium  point.  Using  vf0pti  in  (4),  we 
get  the  optimal  separator  outputs 
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yiopiH  =  auA(n)  ,  yioptin)  =  a22/2(n). 


(12) 


With  the  use  of  an  automatic  gain  control  (AGC),  (amplitude  compensation)  at 
the  output  of  the  separator,  we  obtain 


ViACC  ±  =  A(n),  i  =  1,2  (13) 

a.t 

which  depicts  a  total  compensated  signal  separation. 

3.2  Multidimensional  Correlator-Correlator  Scheme 

From  Fig.  2,  we  write 

y(n)  =  wx(n),  (14) 


where 


wxj 

1 


(15) 


Using  (1)  and  (14)  in  (13),  the  output  of  this  separator  is  given  by 


y.(»)  = 


M 

an  +  5Z 


IDijOj, 


Mr  M  . 

/.•(«)  +  0,7  +  MK»)  +  n*»(n)  (16) 

L  J 


The  first  term  in  (15)  represents  the  desired  signal  at  the  i  th  output  and  the 
second  term  is  the  residual  interference  from  all  other  signals,  while  n0,(n)  is  the 
resultant  Gaussian  noise  at  the  output.  For  the  case  of  the  two  dimensional  signal 
and  no  noise  environment,  we  have  from  (15) 
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yi(n)  =  AIx{n)  + BI2{n) 
y2(n)  =  CIx(n)  +  DI2(n) 


(17) 

where  A,  B,  C  and  D  as  in  (6).  Using  the  same  argument  as  in  (7),  we  conclude  that 
for  the  two  dimensional  case  the  optimum  weights  for  the  correlator-correlator  scheme 
are  also  given  by  (10).  Finally,  using  woptl  in  (16),  we  get  the  optimal  separator 
outputs 


yiopt{n)  =  an[l  - 


Q12Q21 

<Z22all 


}h(n)  , 


y2opt{n)  -  022(1  - 


Q12Q21 

a22°n 


]I2(n). 


(18) 


If  the  channel  matrix  can  be  approximated  by  a  constant,  then  AGC  can  be 
implemented  at  the  output  leading  to 


ViAGC 


yiopt(n) 


a,,(  [1  -  Siisn.] 

1  aj2“n 1 


=  h{n) 


1  =  1,2. 


(19) 


3.3  Multidimensional  Power- Correlator  Scheme 


From  Fig.  3.  the  output  is  given  by 

y(n)  =  wx(n), 


(20) 


where 


r  (i+  +  '"iAf “ij 


w  = 


“'ll 


“M-l.M  J 

(21) 


Similarly,  using  (19)  and  (20)  together  with  (1),  we  obtain 
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»  Af  M  ' i  M  r  M 

Vi(n)  =  a«(l+5j  WijWj^+Y, WijOj,  I  /<(n)+5ja,/(l+]£  wvajt  ^(«)+”a«(n) 

*■  »«  j/i  J  L  j>«  J#» 

(22) 

It  is  similar  to  correlator-correlator  i  th  output  in  (15)  but,  notice  the  added  term 
in  the  desired  response,  /,(n).  As  is  shown  later,  this  term  causes  reduction  in  the 
output  equalization  requirement  without  effecting  its  bandwidth  response  [7].  In  the 
case  of  no  noise  and  two  dimensional  signal  separation,  we  write  from  (21) 

yi(n)  =  Ah{n)  +  BI2{n) ,  y2(n)  =  C7i(n)  +  DI2(n),  (23) 

where 

A  =  (1  -f  Wi2w2i)ait  +  cl2\W\2  ,  B  =  (1  +  u)\2w2i)a\2  +  022^12  , 

C  =  021  A  anw2i  ,  D  =  a22  +  ai2w21. 

(24) 


Similarly,  using  (22)  in  (7),  we  get  the  equilibrium  points 


w  Q2i|  w  [gg!llJSl  Qn|  f25x 

U2211  ~  0llJ  012  °2lJ 

As  before,  we  can  show  that  only  wop<i  is  a  stable  equilibrium  point.  Substituting 


woptl  of  (24)  into  (22),  we  get 


yiopt(n)  =  an/i(n)  .  y2opt(n)  =  a22[l  -  ■-12-21]/2(rt), 

a  22<*n 


and  with  the  use  of  a  suitable  AGC  at  the  outputs  of  ihe  canceler,  we  have 
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yiAGC  — 


yiopt(n) 


a  u 


=  h(n)  ,  V2AGC  = 


y2oPt(n) 


a22[l  - 

1  «2janJ 


=  /2(n). 


(27) 


Notice  that  for  the  power-correlator  structure,  one  of  the  outputs  requires  an  AGC 
normalization  by  a,,,  the  desired  signal  response,  similar  to  that  required  in  power- 
power  structure.  Particularly,  for  an  =  1,  AGC  is  not  needed.  The  other  output 
needs  an  AGC  which  depends  on  the  interfering  signals  coupling  in  a  manner  similar 
to  that  required  in  the  correlator-correlator  case. 

4  Simulation  and  Results 

In  this  section,  we  present  the  Monte  Carlo  simulation  results  for  two  and  three 
signal  separators  based  on  the  three  different  structures  of  bootstrap  and  LMS  algo¬ 
rithms.  The  block  diagram  for  the  simulation  set  up  is  given  in  Fig.  4.  The  channel 
input  7,(n)  i  =  1,2,3  are  random  bipolar  independent  sequences.  Channel  parame¬ 
ters  were  chosen  to  present  different  desired  signal-to-interference  ratios  (SIR)  at  the 
output.  The  signal-to-interference  ratio  is  defined  by  SIR  =  1 0  /  og  [  ( ^ > — ]. 

Without  loss  of  generality,  we  take  a„  =  1  and  cross  coupling  atJ  to  be  the  same 
for  all  i  and  j,  i  ±  j.  Different  atJ  causes  the  canceler’s  input  correlation  matrix  to 
have  different  eigenvalue  spread.  White  Gaussian  noise  is  added  to  the  output  of  the 
channel,  with  signal-to-noise  ratio  (SNR)  of  40  dB.  Such  high  SNR  is  used  in  the 
simulation  to  enable  better  examination  of  cancellation  depth.  The  blind  bootstrap 
separator  in  one  hand  or  the  LMS  separator  in  the  other  are  used  to  rancel  cross 
channel  interferences.  Finally,  wherever  needed,  AGC  is  added  to  t  he  it  put.  of  the 
separators. 

By  setting  all  the  weights  initially  to  zero,  and  providing  a  constraint  wtJ  <  1 
to  search  for  the  optimal  weight  w,]0pti,  we  obtain  learning  curves  from  the  average 
results  for  500  runs.  This  is  done  for  two  and  three  dimensional  interference  chan- 
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nels.  In  Fig.  5,  we  depict  such  learning  curves  for  power-power,  correlator-correlator 
and  power-porrelator  bootstrap  separators  and  the  LMS  separator  with  a  two  sig¬ 
nal  channel.  Since  the  first  two  are  symmetric  structures,  the  results  from  only  one 
output  are  shown.  For  the  second,  we  show  both  outputs,  yi(n)  and  y2(n),  as  they 
are  shown  in  Fig.  3.  As  channel  coupling  parameters,  we  used  afJ  =  0.8.  and  as 
a  convergence  constant  n  we  took  values  0.12,  0.08,  0.08  and  0.2  for  power-power, 
correlator-correlator,  power-correlator  and  the  LMS  signal  separators,  respectively. 
These  values  were  chosen  to  be  slightly  less  than  the  maximum  values  allowed  for 
stability.  From  these  results,  we  note  that  power-power  results  in  a  smaller  steady 
state  interference  residue  than  that  of  the  correlator-correlator  separator  or  output  2 
of  the  power-correlator.  However,  this  residue  is  larger  than  that  of  LMS  or  output  1 
of  the  power-correlator.  The  correlator-correlator  residue  equals  that  of  output  2  of 
the  power-correlator.  Nevertheless,  all  bootstrap  separators  converge  faster  than  the 
LMS  separator. 

In  Fig.  6,  we  depict  the  learning  curves  of  the  three  separators  with  channel 
coupling  parameters  atJ  =  0.4  instead.  Residues  in  this  case  behave  similar  to  Fig. 
5  except  for  the  fact  that  for  correlator-correlator,  the  residue  is  slightly  larger  than 
the  residue  at  output  2  of  the  power-correlator.  The  convergence  constant  n  was 
taken  to  be  equal  to  0.2.  which  is  slightly  less  than  the  maximum  allowable  for  the 
stability  for  this  case  of  channel  parameters.  Comparing  Fig.  5  to  Fig.  6,  we  notice 
that  when  the  channel  coupling  parameter  is  smaller,  the  convergence  is  faster.  To 
examine  the  effect  of  AGC  on  the  separator's  performance,  we  show  Fig.  7,  the 
learning  curves  of  correlator-correlator  with  and  without  AGC.  In  Fig.  8,  we  do 
the  same  for  output  2  of  the  power-correlator  separator.  Note  that  these  are  the 
only  cases  which  require  equalization  via  AGC.  Fig.  9  and  Fig.  10  deal  with  the 
case  of  the  three  signals  channel.  In  Fig.  9,  we  compare  the  learning  curves  of  the 
correlator-correlator  separator  with  and  without  AGC  to  that  of  the  power- power 
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separator  without  AGC.  We  again  use  atJ  =  0.4  and  \i  to  be  the  same  as  in  Figs.  6, 
7  and  8.  From  this  curve,  we  notice  that  by  adding  AGC,  the  correlator-correlator 
learning  curve  becomes  similar  to  that  of  the  power-power  separator.  In  comparing 
the  results  of  this  figure  to  those  obtained  with  the  two-signal  channel,  we  clearly 
notice  a  higher  residue  with  the  former,  due  to  the  added  interfering  signed.  In  Fig. 
10,  we  compare  the  learning  curves  of  the  power-power  separator  to  the  three  outputs 
of  the  power-correlator  separator  when  AGC  is  added  to  the  outputs.  It  is  quite  clear 
from  the  results  with  the  two  and  three  signals’  channel  that,  the  speed  of  convergence 
is  practically  the  same  in  both  cases. 

5  Conclusion 

In  this  appendix,  we  have  extended  the  previously  reported  three  structures  of 
bootstrap  blind  adaptive  separators  to  the  multi-signal  channel  case.  We  suggested 
a  recursive  weight  updating  algorithm  for  the  three  structures  termed  power-power, 
correlator-correlator  and  power-correlator.  The  optimum  weights  for  these  separators 
were  found  analytically  in  the  absence  of  noise.  The  signal  separation  process  was 
shown  via  simulation  by  the  outputs  learning  curve.  It  was  shown  that  the  different 
bootstrap  separators  converge  to  their  steady  states  almost  with  the  same  speed  for 
a  two  or  three  signals  channel.  They  all  converge  faster  than  LMS  regardless  of 
the  value  of  channel  coupling  parameters.  The  steady  state  interference  residues  of 
the  three  separators  are  different,  lowest  for  power-power  and  highest  for  correlator- 
correlator.  One  output  of  power-correlator  results  in  residue  similar  to  that  of  the 
correlator-correlator.  However,  adding  AGC  to  the  correlator-correlator  outputs  or 
one  of  the  outputs  of  the  power- correlator  reduces  the  amount  of  residue,  so  that 
when  AGC  was  added  (where  it  was  needed),  all  separators  behaved  similarly. 
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Fig.  1  Multi-Inputs  Multi-Outputs  Backward/Backward  Bootstrapped 
(Power-Power)  Signal  Separator 


Fig.  2  Multi-Inputs  Multi-Outputs  Forward/Forward  Bootstrapped 
(Correlator-Correlator)  Signal  Separator 


Fig.  3  Multi-Inputs  Multi-Outputs  Forward/Backward  (Power- Correlator)  Signal 

Separator 


Signal  Sqaruor 


Fig.  4  Multi-Input/Output  Interference  Channel  and  Signal  Separator 
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Fig.  6  Convergence  Comparison  of  the  Bootstrapped  Signal  Separators 
for  two-inputs/two-outputs 
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Fig.  7  Convergence  Comparison  of  the  Correlator-Correlator  with  AGC 
for  two-inputs/two-outputs 
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Fig.  8  Convergence  Comparison  of  the  Power- Correlator  with  AGC 
for  two-inputs/two-outputs 
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Fig.  9  Convergence  Comparison  of  Power-Power  and  Correlator- Correlator 
for  Three-inputs  Three-outputs 
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SAMPLE,  3- input /output,  SIR-  4.9  dB,  SNR-  40  dB 


Appendix  G 


Bootstrapped  Spatial  Separation  of  Wideband  Superimposed  Signals 


Abstract 

Bootstrapped  algorithms  were  developed  and  used  for  separation  of  two  signals, 
when  two  versions  of  their  weighted  sum  is  given.  In  this  paper  we  apply  the  bootstrap 
principle  to  the  separation  of  N  signals  transmitted  from  point  sources  at  different, 
unknown  locations,  when  received  by  an  array  of  M  sensors.  We  present  a  general 
structure  of  the  separation  scheme  which  consists  of  delay  elements  and  summation 
only.  Its  input  is  the  M-sensor  output  signals  and  its  output  is  the  estimates  of  the  N 
source  signals.  We  show  that  if  the  source  locations  are  known,  this  system  provides 
a  least  squares  estimate  of  the  source  signals.  If  not,  it  can  adaptively  converge  to  the 
least  squares  solution,  provided  that  some  prior  information  about  the  source  signals 
is  available.  In  particular,  we  present  a  detailed  study  of  the  bootstrapped  algorithm 
for  the  separation  of  two  sources  received  by  two  sensors.  A  simplified  version  of  the 
algorithm  is  presented  and  the  idea  of  adaptively  controlling  the  unknown  delays  is 
discussed.  We  show  that  the  proposed  algorithm  is  a  powerful  tool  for  the  decompo¬ 
sition  of  spatially  mixed  wideband  signals. 


1  Introduction  and  Background 

This  appendix  deals  with  the  scenario  in  which  N  point  sources  are  received  by  M 
omni-directional  sensors.  The  received  signal  at  the  output  of  each  of  the  Af  sensors 
can  be  modeled  by: 

N 

zm(i)  =  S„(*  “  rm(0n))  +  em(<)  m=l,...,Af  ;  \t\<T/2  (1) 

n=l 

where:  sn(t)  is  the  signal  radiated  from  the  n-th  source;  0n  represents  the  coordinates 
(location)  of  the  n-th  source:  and  em(<)  is  the  additive  noise  at  the  m-th  sensor.  In  the 
special  case  of  a  two  dimensional  array  and  far-field  sources,  6n  is  the  source  bearing. 
Tm(0n),  the  travel  time  of  the  n-th  source  from  the  array  origin  to  the  m-th  sensor  is 
given  by: 


~m(0n)  =  -{xmsin0n  +  ymcos6n] 


(2) 


where  c  is  the  propagation  velocity  of  the  signal  wavefront  and  (xm,ym)  are  the 
Cartesian  coordinates  of  the  m-th  sensor.  If  the  array  is  an  equally  spaced  linear 
array  (ESLA)  then  ym  =0  and  xm={m  —  1  )d,  m=l,...,M  where  d  is  the  separation 
between  successive  sensors  and  the  plane  origin  is  assumed  at  the  coordinates  of  the 
first  sensor.  Thus,  (  2)  becomes: 


=  (m  -  l)-sin6n  (3) 

c 

In  general  there  are  MxX  (or  (M-l)xN)  delays  which  are  a  function  of  the  N 
source  locations  9\,...9s  •  For  an  ESLA  there  are  only  i'  different  delays  which  carry 
all  the  spatial  information. 

The  above  model  can  match  ma;  ••  practical  applications  in  different  fields.  In 
passive  sonar  the  source  signals  a.f  \  .cteband,  noise-like  random  processes  and  the 
unknown  source  location  vector.  £  -  ^ ...9N)T  ,  has  to  be  estimated.  In  the  active 
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case  the  source  signals  are  basically  known,  but  the  aim  is  the  same  -  estimation  of  the 
source  locations.  However,  in  a  communication  system,  one  is  usually  interested  in 
the  source  signals  themselves  and  not  in  their  locations  which  are  sometimes  known. 


We  assume  broadband  signals,  which  are  more  general  than  the  usually  assumed 
narrowband  case,  where  a  delay  can  be  regarded  as  a  phase  shift.  The  received  sensor 
data  ( 1 )  can  be  represented  in  the  frequency  domain: 

1  r?/ 2 

Zm(uk)  =  -  zm{t)e  }u>ktdt  ; m  =  1, ..., M  ;k  =  l,...L  (4) 

1  J-T/2 

Zm(uJk)  is  the  Fourier  coefficient  of  the  output  from  the  m-th  sensor  at  frequency 
( 2ir/T)k .  The  processing  bandwidth  is,  therefore,  B  =  L/T.  At  each  frequency,  the 
array  output  is  given  by  the  m-dimensional  vector: 

Z(Wl)  =  (Z1(u>„),...,Z„(l*))T  (5) 

Following  the  model  of  (1),  Z(u>*)  can  be  written  as 

N 

2.M  =  ^  Sn(u}k)a(u;k,  0n)  +  E(uk)  =  A(a>fc£)5(u;fc)  +  E(uk)  (6) 

n=l 

where  S(uk)  =  {Si(uk), ...,  S^u;*))7  and  E{ujk  =  (£i(wfc ),...,  EM(uk))T  .  Sn(u>k) 
and  Em( u>k)  are  the  Fourier  coefficients  of  the  n-th  source  signal  and  the  noise  in  the 
m-th  sensor,  respectively.  Also, 

*4(u;*,£)  =  [a,(wfc)  :  ... :  aN{uk)]  (7) 

where 

a(uk,dn)  =  an(uk)  =  . (8) 
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If  M  >  N  the  least-squares  estimate  of  the  frequency  domain  vector  of  source 
signals,  S(u>),  given  the  data  vector  2(u>),  is  [l]: 

(9) 

For  the  special  case  of  M  =  N  —  2  it  easily  can  be  verified  that 

[A’(u)k,9)A{ujk,9)]~lA'(ujk,e)ZM  = 

1  /  eJU,*D>  _  cosu>kAe3UlkDi  e~]WkDl  —  cosukAe~iWkD7  \.  . 

sin2u A  ^  e*WkDl  —  cosutk Ae2u>kDl  e-JU'k£>2  —  cosu>kAe~^kDl  J  * 

where  A  =  D%  —  D2  •  In  (8)  we  also  assume  that  the  array  origin  reference  is  the  mid 
location  between  the  elements,  so  that  Ti(0i)  =  — r2(0 1)  =  D\,  tx(02)  =  —t2(62)  =  D2 
.  We  see  that,  even  if  D\  and  D2  are  known,  the  implementation  of  the  least  squares 
solution  of  (9)  requires  filtering  the  array  outputs  z,(<)  using  filters  having  transfer 
functions  of  the  form:  cosuA  or  l/sin2uA,  as  well  as  pure  delays  (see  Fig.  1).  The 
implementation  of  the  trigonometric  filters  is  difficult,  especially  when  S  is  unknown 
and  is  to  be  estimated  adaptively.  One  possible  approach  to  deal  with  this  implemen¬ 
tation  problem  is  to  approximate  the  trigonometric  filters  by  FIR  (or  HR)  filters.  In 
the  sequel,  we  show  that  applying  the  bootstrap  principle  to  this  problem  results  in 
an  exact  implementation  of  (9)  which  uses  only  delay  elements  and  summations,  in 
a  feedback  configuration. 


2  The  Bootstrapped  Algorithm 


Bootstrapped  systems  are  multi-input  multi-output  feed-back  systems  in  which 
each  output  "helps”  to  improve  the  other  outputs.  The  idea  is  to  assume  that  a 
system  output  is  indeed  the  desired  response  and  to  use  it,  via  feedback,  to  get  other 
outputs.  This  approach  has  been  successfully  applied  in  satellite  communication  to 
improve  separation  of  cross-pol  signals  [2].  In  our  problem,  given  any  N- 1  source 
signals  one  can  get  a  good  estimate  of  the  remaining  signal,  say  sn  ( t )  from  any  of  the 
sensor  outputs  using: 


N 

Snm{t)  =  Sn(t  ~  Tm(dn))  =  Zm(t)  -  ^  Si(t  -  Tm(0,)))  (11) 

(*=l)i^n 

If  no  noise  exists,  then  the  left  hand  side  of  (11)  is  indeed  a  delayed  version  of 
sn(t).  However,  since  noise  is  never  zero,  averaging  over  the  estimated  version  of  a 
certain  signal  from  all  sensor  outputs  will  improve  SNR  output.  Therefore,  we  have: 

+*•<».•))  <12) 

The  outputs  of  the  proposed  algorithm  are  N  signals,  yi(t),  ...,yN(t)  which  are 
desired  to  be  the  best  possible  estimates  of  the  N  source  signals  si(t),...,s/v(t).  Fol¬ 
lowing  the  bootstrapped  approach,  we  replace  the  known  source  signals  in  (11)  by 
their  estimates  {y,}.  Therefore,  the  proposed  scheme  is  described  by  the  NxM  equa¬ 
tions: 


N 

ynm(t)  =  yn{t  -  Tm(0n))  =  Zm(t)  -  ^2  -  rm(0,)) 


;  m  =  1, ....  M:  n  =  1. 


N 


(13) 


,  M 

Vn(i)  =  *52  ynm(t  +  Tm(d,))  (14) 
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By  transforming  (13)  to  the  frequency  domain  we  get 


Yn(u) 


_1_ 

M 


£  e3"Tml8n)[Zm(u) 


m=l 


£  ;  m  =  1, 


In  a  matrix  form  this  equation  is  equivalent  to 


M;  n  =  1, N 
(15) 


A*(u;,0)A(u;,£)y(u>)  =  A'(uj,8)Z{uj)  (16) 

where  A(u>,0)  is  given  by  (7)  and  (8).  Therefore,  the  frequency  domain  representa¬ 
tion  of  the  output  vector  y(t)  =  (yi{t), . ~,yN{t))T  is  exactly  the  same  as  S(u>k)  of  (9). 
i.e.,  the  system  described  by  (12)  is  a  realization  of  the  least  squares  estimator  of  the 
source  signals.  In  Fig.  2  we  present  a  block  diagram  of  this  system  for  the  special 
case  of  N  =  M  ~  2. 
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3  Bootstrapped  Separation  of  Sources  at  Unknown 
Locations 

If  the  sources  location  is  unknown,  then  0  =  ( 0\,...,0n)t  is  unknown,  and  rm{Bt ) 
in  (9)  is  replaced  by  its  estimate,  fm,  =rm(0,),  m  =  1  i  =  1  In  that 

case,  the  frequency  domain  representation  of  the  output  vector  is: 

YM  =  [A-(u>kA)A(u;k,0)]-\A-(uk,0)Z(uJk)  =  [AmA\'lAmZ  (17) 

This  is  no-longer  the  least  square  estimate  of  S.{u>k),  but  only  an  approximation. 

In  the  sequel,  we  propose  an  adaptive  algorithm  by  which  an  estimate  of  the  de¬ 
lays  Di  will  be  found.  We  show  that,  in  case  of  no  additive  noise,  the  algorithm 
converges  to  the  least  squares  solution  of  (9).  We  demonstrate  our  results  for  the 
special  case  where  :V  =  M  =  2.  However,  generalization  of  the  algorithm  for  any 
M  >  N  >  2  is  straight  forward.  Consider  the  system  of  Fig.  3.  It  can  be  shown  that 
for  T\(0i)  =  -t2(0 i)  =  D\.  tx{02)  -  ~-t2(62)  =  Z?2,  the  2x2  transfer  function  matrix, 
H(u>),  which  relates  the  two  outputs.  y,(t)  and  y2(t)  to  the  two  inputs  z\(t)  and  z2(t) 
is  exactly  the  same  as  those  of  the  system  of  Figs.  1  and  2.  That  is,  the  system 
of  Fig.  3  is  another,  alternative  implementation  of  a  least  squares  separator  with 
H(tjj)  given  by  (10).  If  initially  tj  /  D\  and/or  r2  ^  D2,  then  we  intend  to  adapt  rj 
and  r2  so  that  in  the  steady  state  they  reach  these  optimal  values.  We  notice  that 
the  scheme  of  Fig.  3  is  similar  to  the  bootstrapped  ” power- power r  separator  of  [2-7] 
which  is  applied  to  the  separate  weighted  sum  of  two  uncorrelated  signals.  There,  the 
delays  tx  and  r2  are  replaced  by  complex  weights,  say  and  IV2.  In  the  frequency 
domain  our  unknown  delays  are  represented  by  eJU,Tl  and  e and  the  input  signals 
are  weighted  sums  of  the  uncorrelated  frequency  domain  signals  5](u?)  and  S2(w). 
Therefore,  the  frequency  domain  representation  of  our  problem  is  equivalent  to  the 
time  domain  separation  problem  of  [2-10]  and  a  similar  approach  can  be  considered. 

It  was  shown  there  that  without  noise  (  m  =  n2  =  0  ),  the  power  of  the  two  out- 
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put  signals  is  minimal  if  and  only  if  the  controlled  weights  are  equal  to  the  unknown 
model  parameters.  It  was  also  shown  that  for  this  configuration,  the  optimization  cri¬ 
terion  of  minimum  power  is  equivalent  to  the  criterion  of  zero  correlation  between  the 
two  outputs  [3-4].  By  analogy,  in  our  problem  the  equivalent  optimization  criterion 
should  be  minimum  power  (or  zero  correlation)  in  the  frequency  domain.  However, 
since  power  and  correlation  are  preserved  when  transforming  from  time  to  frequency 
and  vice  versa  (Parseval),  this  criterion  can  be  applied  to  our  problem  either  in  the 
frequency  domain,  or  in  the  time  domain.  Inspirated  by  a  possible  hardware  imple¬ 
mentation  using  voltage  controlled  delay  lines,  we  prefer  the  time  domain  approach. 
That  is,  we  suggest  to  control  the  unknown  delays  T\  and  r2  by  an  adaptive  algo¬ 
rithm  which  seeks  for  the  minimum  power  of  both  outputs,  simultaneously  (or,  for 
the  minimum  power  of  their  cross  correlation  signal).  Notice,  however,  that  this  con¬ 
trol  procedure  cannot  be  employed  unless  some  information  that  distinguishes  the 
signals  to  be  separated  is  available.  Mathematically,  it  can  be  shown  that  all  possible 
optimization  criteria  (zero  correlation  13,  minimum  power)  yield  the  same,  or  linearly 
dependent,  control  equations.  Notice,  however,  that  to  control  both  T\  and  r2  one 
needs  two  independent  equations.  This  difficulty  can  also  be  predicted  by  considering 
the  separation  problem  as  a  multi-input  multi-output  identification  problem,  where 
it  is  well  known  that  weighted  sums  cannot  be  separated  if  nothing  is  known  about 
their  components.  In  our  application,  it  is  also  well  known  that  the  resolution  ca¬ 
pacity  of  an  array  of  M  sensors  is  bounded  by  the  number  of  sensors  (i.e.,  M  >  N) 
if  absolutely  nothing  is  known  about  the  signals.  Conversely,  if  prior  information  is 
available,  it  can  be  used  to  discriminate  between  the  two  signals  in  the  control  loops. 
Thus,  as  suggested  in  [3.4],  such  a  dependency  problem  can  be  handled  by  introducing 
a  ’'discriminator"  which  uses  the  distinguishing  information  to  emphasize  sx(t)  in  one 
of  the  control  loops  and  another  one  which  emphasizes  s2(f)  in  the  other  loop.  This 
l3Lately  the  de-correlation  approach  is  also  used  in  [11] 
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procedure  yields  two  independent  control  equations,  which  guarantees  convergence  of 
the  adaptive  algorithm  to  the  desired  solution  t*  =  D\  and  r2  =  Z)2.  The  possible 
control  loops  are  depicted  in  Fig.  4. 


4  Conclusions 

For  separation  of  signals  radiated  from  point  sources,  we  propose  the  system  of 
Fig.  3.  where  the  delays  are  controlled  by  any  of  the  algorithms  of  Fig.  4  (there 
are  4  different  combinations,  for  two  unknown  delays).  We  have  shown  that  if  the 
delays  are  adapted  to  the  unknown  model  parameters  exactly,  then  the  outputs  of 
the  proposed  bootstrapped  system  are  the  least-squares  estimates  of  the  source  sig¬ 
nals.  In  a  further,  on-going  study  we  investigate  the  adaptive  algorithm  with  more 
details,  we  suggest  alternative  implementations  of  the  separation  configuration  and 
we  study  the  effect  of  the  additive  noise  on  the  performance  of  the  proposed  separator. 
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Fig.  1  Direct  Implementation  of  the  Least-Squares  Operator. 
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Fig.  2  Bootstrapped  Implementation  of  the  Least-Squares  Separator. 
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Fig.  4  Block  Diagram  of  the  Delay  Control  Algorithms. 
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